Display apparatus and display method

ABSTRACT

An adequate display operation control in accordance with the external world situation is realized. For example, where a user wears the wearing unit of a spectacle-shaped or head-worn unit, the user is made to be able to view any type of image on the display section immediately in front of the eyes, and provided with taken images, reproduced images, and received images. At the point, a control relative to various display operations such as on/off of the display operation, display operation mode, and source chage is carried out based on external world information.

CROSS REFERENCE TO RELATED APPLICATION

The present application is a continuation of U.S. application Ser. No.14/612,722, filed on Feb. 3, 2015, which is a continuation of U.S.application Ser. No. 12/440,591, filed on Mar. 10, 2009, which was theNational Stage of International Application No. PCT/JP2007/066001, filedon Aug. 17, 2007, which claimed priority to Japanese Application No.2006-261976, filed on Sep. 27, 2006, the entire contents of which areincorporated herein by reference in their entirety.

TECHNICAL FIELD

The present invention relates to a display apparatus for displaying animage with display means arranged in front of an eye of a user while thedisplay apparatus is mounted by the user using, for example, a wearingunit in the shape of spectacles or a wearing unit to be mounted on ahead of the user. The present invention also relates to a displaymethod.

BACKGROUND ART

As disclosed in Japanese Patent Laid-open Nos. Hei 8-126031, Hei9-27970, and Hei 9-185009, various types of apparatuses for displayingan image with a display section arranged in front of an eye of a user byuse of a spectacle-shaped or head-worn unit have already been proposed.

However, no known apparatuses are capable of performing a desirabledisplay operation in accordance with the situation without the need forthe user to operate an operation unit, such as an operation key.

Consequently, the object of the present invention is to enable anappropriate or entertaining display operation to be performed inaccordance with an outside world situation (e.g., a surroundingenvironment, a date and time, a place, an input image, etc.).

DISCLOSURE OF INVENTION

A display apparatus of the present invention includes: display means tobe arranged in front of an eye of a user for displaying an image;outside world information acquisition means for acquiring outside worldinformation; and control means for controlling an operation of thedisplay means based on the information acquired by the outside worldinformation acquisition means.

Additionally, it further includes imaging means for photographing animage. Further, in this case, the control means controls the image dataphotographed by the imaging means to be displayed on the display means,based on the information acquired by the outside world informationacquisition means.

Also, it further includes reproduction means for reproducing data from astorage medium. Further, in this case, the control means controls thedata reproduced by the reproduction means to be displayed on the displaymeans, based on the information acquired by the outside worldinformation acquisition means.

Also, it further includes reception means for communicating with anexternal device to receive data. Further, in this case, the controlmeans controls the data received by the reception means to be displayedon the display means, based on the information acquired by the outsideworld information acquisition means.

Also, the display means can switch between a transparent or translucentthrough state and a displaying state in which data supplied isdisplayed.

Also, the outside world information acquisition means is a sensor fordetecting a situation of a surrounding environment as the outside worldinformation.

Also, the outside world information acquisition means is a sensor fordetecting information concerning an imaging object of the imaging meansas the outside world information.

Also, the outside world information acquisition means acquires currentposition information as the outside world information.

Also, the outside world information acquisition means acquires a currentdate and time as the outside world information.

Also, the outside world information acquisition means acquires theoutside world information via communication with an external device.

Also, the outside world information acquisition means acquires theoutside world information via image analysis performed with respect toan image supplied to the display means.

Also, the outside world information acquired by the outside worldinformation acquisition means is information of a brightness,temperature, humidity, atmospheric pressure, or weather of surroundings.

Also, the outside world information acquired by the outside worldinformation acquisition means is information of a place corresponding toa current position.

Also, the outside world information acquired by the outside worldinformation acquisition means is information of a structure or naturalobject in an area corresponding to a current position.

Also, the outside world information acquired by the outside worldinformation acquisition means is information for identifying a specifiedobject included in input image data.

Also, the outside world information acquired by the outside worldinformation acquisition means is information for identifying a person,an animal, a structure, a natural object, or a device as a specifiedobject included in input image data.

Also, the outside world information acquired by the outside worldinformation acquisition means is information of a motion of an objectincluded in input image data.

Also, the outside world information acquired by the outside worldinformation acquisition means is information for identifying anindividual person included in input image data.

Also, the outside world information acquired by the outside worldinformation acquisition means is information for determining whether ornot input image data includes a letter image.

Also, the outside world information acquired by the outside worldinformation acquisition means is information of brightness or clearnessof input image data.

Also, the outside world information acquired by the outside worldinformation acquisition means is information of brightness or clearnessof a part of an image of input image data.

Also, the control means controls start/termination of a displayoperation in the display means.

Also, the control means controls the display means to switch between thethrough state and the displaying state.

Also, the control means controls switching of a source from which datato be displayed on the display means is supplied.

Also, the control means controls magnification/reduction of the imagedisplayed on the display means.

Also, the control means controls highlighting display of a part of ascreen displayed on the display means.

Also, the control means controls split screen display performed in thedisplay means.

Also, the control means controls display brightness in the displaymeans.

Also, the control means controls signal processing performed on a signalof the image to be displayed by the display means.

Also, it further includes speech synthesis means for performing speechsynthesis based on a letter included in the image to be supplied to thedisplay means, and audio output means for outputting audio generated bythe speech synthesis means.

A display method of the present invention includes, as a display methodemployed in a display apparatus including display means to be arrangedin front of an eye of a user for displaying an image, an outside worldinformation step for acquiring outside world information, and controlstep for exercising control related to a display operation performed inthe display means based on the information acquired in the outside worldinformation acquiring step.

In the present invention above, a user wears the display apparatususing, for example, a spectacle-shaped or head-worn unit or the like, sothat the user can view the display means arranged in front of the eye.That is, while wearing the display apparatus, the user is able to viewthe image photographed by the imaging means, the image of the datareproduced by the reproduction means, the image of the data received bythe reception means, or the like via the display means.

Here, it is preferable that control related to the display operation,such as On/Off/through control of the display operation, selection ofthe source of the image data to be displayed, control of various typesof display operation modes (e.g., split screen display,magnification/reduction display, display image quality control such ascontrol of the display brightness, highlighting of a part of the image,etc.), or switching of input to the display means, be performed inaccordance with the situation. According to the present invention,various types of control are performed based on the outside worldinformation, instead of by the user operating an operation unit.

According to the present invention, various images are displayed on thedisplay means arranged in front of the eye of the user. At this time,control related to the display operation is performed based on theoutside world information without the need for the user to perform anyoperation, so that an appropriate or entertaining display operationsuited to the situation is performed. Thus, the display apparatus isconvenient for the user, and is capable of providing a variety of sceneswithin his or her field of vision.

Moreover, since the display means is capable of entering a transparentor translucent through state, it is possible to prevent an interferencefrom occurring in the user's daily life even while the user is wearingthe display apparatus. Thus, advantages of the display apparatusaccording to the present invention can be enjoyed effectively in theuser's daily life.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is an illustration of an exemplary appearance of a displayapparatus according to the present invention.

FIG. 2 shows diagrams illustrating forms of usage of the displayapparatus according to one embodiment.

FIG. 3 is a block diagram illustrating an exemplary structure of adisplay apparatus according to one embodiment.

FIG. 4 is a block diagram illustrating another exemplary structure of adisplay apparatus according to one embodiment.

FIG. 5 illustrates a through state and states in which photographedimages are being displayed, according to one embodiment.

FIG. 6 illustrates each state in which an image obtained from a storagesection according to one embodiment is being displayed.

FIG. 7 illustrates each state in which an image obtained from acommunication section according to one embodiment is being displayed.

FIG. 8 illustrates each state in which an image obtained from acommunication section according to one embodiment is being displayed.

FIG. 9 illustrates split screen display according to one embodiment.

FIG. 10 illustrates each state in which a magnified image is beingdisplayed, according to one embodiment.

FIG. 11 illustrates each state in which a brightness-adjusted image isbeing displayed, according to one embodiment.

FIG. 12 shows views for illustrating image processing according to oneembodiment.

FIG. 13 is a flowchart illustrating a control procedure according to oneembodiment.

FIG. 14 is a flowchart illustrating a procedure for determiningoccurrence of a display control trigger according to one embodiment.

FIG. 15 is a flowchart illustrating a procedure for determiningoccurrence of a display control trigger according to one embodiment.

FIG. 16 is a flowchart illustrating a procedure for determiningoccurrence of a display control trigger according to one embodiment.

FIG. 17 is a flowchart illustrating a procedure for determiningoccurrence of a display control trigger according to one embodiment.

FIG. 18 is a flowchart illustrating a procedure for determiningoccurrence of a display control trigger according to one embodiment.

FIG. 19 shows flowcharts illustrating procedures for determiningoccurrence of a display control trigger according to one embodiment.

FIG. 20 shows flowcharts illustrating procedures for determiningoccurrence of a display control trigger according to one embodiment.

FIG. 21 shows flowcharts illustrating procedures for determiningoccurrence of a display control trigger according to one embodiment.

FIG. 22 shows flowcharts illustrating procedures for determiningoccurrence of a source switch trigger according to one embodiment.

FIG. 23 shows flowcharts illustrating procedures for determiningoccurrence of a source switch trigger according to one embodiment.

BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, display apparatuses and a display method according toembodiments of the present invention will be described in the followingorder.

[1. Exemplary appearance of display apparatus and relationships withexternal devices]

[2. Exemplary structures of display apparatus]

[3. Exemplary displays]

[4. Detection of outside world information]

[5. Various exemplary operations]

[6. Effects of embodiments, exemplary variants, and exemplaryexpansions]

[1. Exemplary Appearance of Display Apparatus and Relationships withExternal Devices]

According to one embodiment, FIG. 1 shows an exemplary appearance of adisplay apparatus 1 formed as spectacle-shaped display. The displayapparatus 1 has a wearing unit having a frame structure that extendshalfway around a head from both temporal regions to an occipital region,for example, and is worn by a user with the wearing unit placed overears as illustrated in this figure.

The display apparatus 1 has a pair of display sections 2, 2 designed forleft and right eyes, and the display sections 2 are arranged in front ofthe eyes of the users, i.e., at positions where lenses of commonspectacles would be located, when the display apparatus 1 is worn in amanner as illustrated in FIG. 1. Liquid crystal panels, for example, areused for the display sections 2, and the display sections 2 are capableof entering a through state, i.e., a transparent or translucent state,as illustrated in this figure by transmissivity control. The capabilityof the display sections 2 to enter the through state allows the user towear at all times as he or she wears spectacles, with no interferenceoccurring in his or her daily life.

In addition, a photographic lens 3 a is arranged to face forward so asto photograph in a direction that the user will see as a direction for asubject when the user wears.

In addition, a lighting section 4 a for providing illumination in adirection of photographing by the photographic lens 3 a is provided. Thelighting section 4 a is formed by a light emitting diode (LED), forexample.

In addition, a pair of earphone speakers 5 a that can be inserted intoright and left earholes of the user when the user wears is provided.Note that only the left earphone speaker 5 a is shown in the figure.

In addition, microphones 6 a and 6 b for collecting external sounds isprovided. They are arranged to the right of the right display section 2for a right eye and to the left of the left display section 2 for a lefteye, respectively.

Note that FIG. 1 only shows one example, and that various structures arepossible for the user to wear the display apparatus 1. In general, arequirement for the wearing unit is that it be in the shape ofspectacles or of a head-mount type. At least, a requirement in thepresent embodiment is that it allows the display sections 2 to bearranged in front of and close to the eyes of the user. Also note that,instead of having the pair of display sections 2 provided for both eyes,only one of the display sections 2 for one eye may be provided.

Also note that the earphone speakers 5 a do not have to be the right andleft speakers, but may have only one of the earphone speakers 5 a to beinserted into only one earhole. Also note that the number of microphonesmay be only one of the microphones 6 a and 6 b.

Also note that, although FIG. 1 shows an example that an imagingfunction is included, an example without an imaging function isconceivable.

Also note that the display apparatus 1 need not have any microphone orearphone speaker. Also note that the configuration that the lightingsection 4 a is not provided is conceivable.

Meanwhile, exemplary internal structures of the display apparatus 1 willbe described below. However, the display apparatus 1 may have areproducing function (a storage section 25 described below withreference to FIGS. 3 and 4) of reproducing data from a storage medium,and a communication function (a communication section 26 described belowwith reference to FIGS. 3 and 4) of communicating with an externaldevice.

Thus, conceivable sources of data of an image to be displayed on thedisplay sections 2 include an imaging function portion, a reproducingfunction portion, and a communication function portion.

FIG. 2 shows exemplary modes of use of the display apparatus 1 inrelation to external devices.

(a) of FIG. 2 shows a case in which the display apparatus 1 is usedsingly. In this case, if the display apparatus 1 has the imagingfunction, the display apparatus 1 is capable of displaying photographedimage data on the display sections 2. Meanwhile, if the displayapparatus 1 has the reproducing function, the display apparatus 1 iscapable of displaying an image based on the data reproduced from thestorage medium on the display sections 2. Examples of the datareproduced from the storage medium include a variety of data that can bestored in the storage medium to be displayed, such as: a video contentsuch as a film or a video clip; a still image content photographed by adigital still camera or the like and stored in the storage medium; dataof an electronic book or the like; computer use data such as image data,text data, or spreadsheet data created by the user using a personalcomputer or the like and stored in the storage medium; and a game imagebased on a game program stored in the storage medium.

(b) of FIG. 2 shows a case where the display apparatus 1 has thecommunication function and communicates with an external imagingapparatus 70. In this case, the display apparatus 1 receives an image(video or a still image) photographed by the imaging apparatus 70, anddisplays the received image on the display sections 2. Examples of theexternal imaging apparatus 70 include a video camera and a digital stillcamera having the communication function. In addition, the displayapparatus 1 having the imaging function as illustrated in FIG. 1 can beconceived as the external imaging apparatus 70 for a certain displayapparatus 1.

Moreover, various types of external imaging apparatuses 70 areconceivable. For example, it may be an imaging apparatus possessed bythe user who uses the display apparatus 1, an imaging apparatuspossessed by an acquaintance of the user of the display apparatus 1, oran imaging apparatus possessed by a public institution, a servicecompany, or the like that provides images and which is capable ofcommunicating with the display apparatus 1.

(c) of FIG. 2 shows a case where the display apparatus 1 has thecommunication function and communicates with an external content sourcedevice 71. In this case, the display apparatus 1 receives an image(video or a still image) provided from the content source device 71, anddisplays the received image on the display sections 2.

Examples of the content source device 71 include: AV (audio-visual)equipment such as video equipment, a television tuner, or a home server;and information processing apparatuses such as the personal computer, aPDA (personal digital assistant), or a mobile phone. Similarly, varioustypes of content source devices 71 are conceivable, such as: a devicepossessed by the user who uses the display apparatus 1, a devicepossessed by an acquaintance of the user who uses the display apparatus1, or a server device of a public institution, a service company, or thelike that provides various contents.

Examples of data transmitted from the content source device 71 to thedisplay apparatus 1 include a variety of data that can be displayed,such as: the video content such as the film or the video clip; the stillimage content photographed by the digital still camera or the like andstored in the storage medium; the data of the electronic book or thelike; the computer-readable data such as the image data, the text data,or the spreadsheet data created by the user using the personal computeror the like; and the game image.

(d) of FIG. 2 shows a case where the display apparatus 1 has thecommunication function, in particular, a function of accessing a network73 such as the Internet, and thereby communicates with the externalimaging apparatus 70 or the content source device 71 connected to thedisplay apparatus 1 via the network 73. In this case, the displayapparatus 1 receives various data via the network 73, and displays animage of the received data on the display sections 2.

[2. Exemplary Structures of Display Apparatus]

FIG. 3 shows an exemplary internal structure of the display apparatus 1.

A system controller 10 is formed by a microcomputer that includes a CPU(central processing unit), a ROM (read only memory), a RAM (randomaccess memory), a nonvolatile memory section, and an interface section,for example, and controls an overall operation of the display apparatus1.

Based on an outside world situation, the system controller 10 controlseach part of the display apparatus 1. That is, the system controller 10operates in accordance with an operating program for detecting anddetermining the outside world situation and controlling an operation ofeach part of the display apparatus 1 in accordance with the detected anddetermined outside world situation. Therefore, from the viewpoint offunctions, the display apparatus 1 has, as shown in the figure, anoutside world situation determination function 10 a of determining theoutside world situation, and an operation control function 10 b ofissuing a control instruction to each part of the display apparatus 1 inaccordance with the outside world situation determined by the outsideworld situation determination function 10 a.

The display apparatus 1 includes, as units for photographing a sceneahead of the user, an imaging section 3, an imaging control section 11,and an imaging signal processing section 15.

The imaging section 3 includes: a lens system formed by the photographiclens 3 a illustrated in FIG. 1, a diaphragm, a zoom lens, a focus lens,and the like; a driving system for allowing the lens system to perform afocusing operation, a zooming operation, and the like; and a solid-stateimaging device array for detecting light for imaging obtained by thelens system, and subjecting the detected light to optical-to-electricalconversion to generate an imaging signal. The solid-state imaging devicearray is, for example, a CCD (charge coupled device) sensor array or aCMOS (complementary metal oxide semiconductor) sensor array.

The imaging signal processing section 15 includes a sample-hold/AGC(automatic gain control) circuit for subjecting the signal obtained bythe solid-state imaging device in the imaging section 3 to gain controland waveform shaping, and a video A/D converter, and obtains an imagingsignal in digital form. In addition, the imaging signal processingsection 15 performs white balancing processing, brightness processing,color signal processing, blur correction processing, and the like on theimaging signal.

Based on the instruction issued from the system controller 10, theimaging control section 11 controls operations of the imaging section 3and the imaging signal processing section 15. For example, the imagingcontrol section 11 controls activation and deactivation of theoperations of the imaging section 3 and the imaging signal processingsection 15. In addition, the imaging control section 11 exercisescontrol (motor control) for allowing the imaging section 3 to performoperations such as autofocusing, automatic exposure adjustment, apertureadjustment, and zooming.

The imaging control section 11 includes a timing generator, and uses atiming signal generated by the timing generator to control signalprocessing operations performed by the solid-state imaging device, andthe sample-hold/AGC circuit and the video A/D converter in the imagingsignal processing section 15. Moreover, this timing control enablesvariable control of an imaging frame rate.

In addition, the imaging control section 11 controls imaging sensitivityand signal processing in the solid-state imaging device and the imagingsignal processing section 15. For example, as control of the imagingsensitivity, the imaging control section 11 is capable of performing thegain control on the signal read from the solid-state imaging device, andblack level setting, control of various coefficients in processing theimaging signal in digital form, control of a correction value in theblur correction processing, and the like. Regarding the control of theimaging sensitivity, overall sensitivity adjustment with no regard toany particular wavelength range, and sensitivity adjustment of adjustingimaging sensitivity of a particular wavelength range such as an infraredrange or an ultraviolet range (for example, imaging that involvescutting off the particular wavelength range) are possible, for example.Sensitivity adjustment in accordance with the wavelength is achieved byinsertion of a wavelength filter in a photographic lens system or awavelength filter operation process performed on the imaging signal. Inthese cases, the imaging control section 11 achieves the sensitivitycontrol by controlling the insertion of the wavelength filter,specification of a filter operation coefficient, or the like.

The imaging signal (i.e., the photographed image data) obtained byimaging by the imaging section 3 and processing by the imaging signalprocessing section 15 is supplied to an image input/output controlsection 27.

Under control of the system controller 10, the image input/outputcontrol section 27 controls transfer of the image data. Specifically,the image input/output control section 27 controls transfer of the imagedata among an imaging system (i.e., the imaging signal processingsection 15), a display system (i.e., a display image processing section12), the storage section 25, and the communication section 26.

For example, the image input/output control section 27 performs anoperation of supplying the imaging signal (i.e., the image data)processed by the imaging signal processing section 15 to the displayimage processing section 12, the storage section 25, or thecommunication section 26.

Also, the image input/output control section 27 performs an operation ofsupplying the image data reproduced from the storage section 25 to thedisplay image processing section 12 or the communication section 26, forexample.

Also, the image input/output control section 27 performs an operation ofsupplying the image data received via the communication section 26 tothe display image processing section 12 or the storage section 25, forexample.

The display apparatus 1 includes, as units for presenting a display tothe user, the display section 2, the display image processing section12, a display driving section 13, and a display control section 14.

For example, the image data as the imaging signal obtained by imaging bythe imaging section 3 and processing by the imaging signal processingsection 15 can be supplied to the display image processing section 12via the image input/output control section 27. The display imageprocessing section 12 is, for example, a so-called video processor, andis capable of performing various display processes on the supplied imagedata. For example, the display image processing section is capable ofperforming brightness level control, color correction, contrast control,sharpness (edge enhancement) control, and the like on the image data. Inaddition, the display image processing section 12 is also capable of:generation of a magnified image in which a part of the supplied imagedata is magnified; generation of a reduced image; division orcombination of an image(s) for split screen display of the suppliedimage data; image processing for highlighting (emphasizing) displaying apart of an image displayed; generation of a character image or aconceptual image; combination of a generated image with the suppliedimage data; and the like. In short, the display image processing section12 is capable of performing various processes on the supplied imagedata.

The display driving section 13 is formed by a pixel driving circuit forallowing the image data supplied from the display image processingsection 12 to be displayed on the display section (e.g., a liquidcrystal display) 2. That is, the display driving section 13 appliesdriving signals based on a video signal to pixels arranged in a matrixin the display section 2 with specified horizontal/vertical drivingtiming for displaying. In addition, the display driving section 13 iscapable of controlling transmissivity of each of the pixels in thedisplay section 2 to cause the display section 2 to enter the throughstate.

Based on the instruction issued from the system controller 10, thedisplay control section 14 controls a processing operation of thedisplay image processing section 12 and an operation of the displaydriving section 13. Specifically, the display control section 14controls the display image processing section 12 to perform theaforementioned various processes. Also, the display control section 14controls the display driving section 13 to switch between the throughstate and an image displaying state.

The image data reproduced in the storage section 25 and the image datareceived via the communication section 26 can also be supplied to thedisplay image processing section 12 via the image input/output controlsection 27. In this case, a reproduced image or a received image isoutputted via the display section 2 by the above-described operations ofthe display image processing section 12 and the display driving section13.

The display apparatus 1 further includes an audio input section 6, anaudio signal processing section 16, and an audio output section 5.

The audio input section 6 includes the microphones 6 a and 6 billustrated in FIG. 1, a microphone amplifier section for amplifyingaudio signals obtained by the microphones 6 a and 6 b, and an A/Dconverter, and outputs audio data.

The audio data obtained by the audio input section 6 is supplied to anaudio input/output control section 28.

Under control of the system controller 10, the audio input/outputcontrol section 28 controls transfer of the audio data. Specifically,the audio input/output control section 28 controls transfer of the audiosignal among the audio input section 6, the audio signal processingsection 16, the storage section 25, and the communication section 26.

For example, the audio input/output control section 28 performs anoperation of supplying the audio data obtained by the audio inputsection 6 to the audio signal processing section 16, the storage section25, or the communication section 26.

Also, the audio input/output control section 28 performs an operation ofsupplying audio data reproduced in the storage section 25 to the audiosignal processing section 16 or the communication section 26, forexample.

Also, the audio input/output control section 28 performs an operation ofsupplying audio data received via the communication section 26 to theaudio signal processing section 16 or the storage section 25, forexample.

The audio signal processing section 16 is formed by a digital signalprocessor, a D/A converter, and the like, for example. The audio dataobtained by the audio input section 6, the audio data reproduced in thestorage section 25, or the audio data received via the communicationsection 26 is supplied to the audio signal processing section 16 via theaudio input/output control section 28. Under control of the systemcontroller 10, the audio signal processing section 16 performs a processsuch as volume control, tone control, or application of a sound effecton the supplied audio data. Then, the audio signal processing section 16converts the processed audio data into an analog signal, and suppliesthe analog signal to the audio output section 5. Note that the audiosignal processing section 16 is not limited to a unit that performsdigital signal processing, but may be a unit that performs signalprocessing using an analog amplifier, an analog filter, or the like.

The audio output section 5 includes the pair of earphone speakers 5 aillustrated in FIG. 1 and an amplifier circuit for the earphone speakers5 a.

The audio input section 6, the audio signal processing section 16, andthe audio output section 5 enable the user to listen to an externalsound, audio reproduced in the storage section 25, or audio received viathe communication section 26. Note that the audio output section 5 maybe formed by a so-called bone conduction speaker.

The storage section 25 is a section for recording data on or reproducingdata from a predetermined storage medium. For example, the storagesection 25 is formed by a hard disk drive (HDD). Needless to say, asthis storage medium, various types of storage media are adoptable suchas: a solid-state memory such as a flash memory, a memory cardcontaining a fixed memory, an optical disk, a magneto-optical disk, anda hologram memory. A requirement for the storage section 25 is to becapable of recording and reproducing the data in accordance with theadopted storage medium.

The image data as the imaging signal obtained by imaging by the imagingsection 3 and processing by the imaging signal processing section 15 andthe image data received via the communication section 26 can be suppliedto the storage section 25 via the image input/output control section 27.In addition, the audio data obtained by the audio input section 6 andthe audio data received via the communication section 26 can be suppliedto the storage section 25 via the audio input/output control section 28.

Under control of the system controller 10, the storage section 25encodes the supplied image or audio data for the data to be recorded onthe storage medium, and records the encoded data on the storage medium.

In addition, under control of the system controller 10, the storagesection 25 reproduces the image or audio data from the storage medium.The image data reproduced is outputted to the image input/output controlsection 27, whereas the audio data reproduced is outputted to the audioinput/output control section 28.

The communication section 26 transmits and receives data to and from theexternal device. As the external device, various devices as the imagingapparatus 70 or the content source device 71 as described above withreference to FIG. 2, or the like are conceivable.

The communication section 26 may be configured to perform networkcommunication via short-range wireless communication for a networkaccess point, for example, in accordance with a system such as awireless LAN, Bluetooth, or the like. Alternatively, the communicationsection 26 may perform wireless communication directly with an externaldevice having a corresponding communication function.

The image data as the imaging signal obtained by imaging by the imagingsection 3 and processing by the imaging signal processing section 15 andthe image data reproduced in the storage section 25 can be supplied tothe communication section 26 via the image input/output control section27. In addition, the audio data obtained by the audio input section 6and the audio data reproduced in the storage section 25 can be suppliedto the communication section 26 via the audio input/output controlsection 28.

Under control of the system controller 10, the communication section 26subjects the supplied image or audio data to encoding, modulation, andthe like for transmission, and transmits the resulting data to theexternal device.

The communication section 26 also performs an operation of receivingdata from the external device. Image data received and demodulated isoutputted to the image input/output control section 27, whereas audiodata received and demodulated is outputted to the audio input/outputcontrol section 28.

The display apparatus 1 further includes a speech synthesis section 29.In accordance with the instruction issued from the system controller 10,the speech synthesis section 29 performs speech synthesis to output anaudio signal.

The audio signal outputted from the speech synthesis section 29 issupplied to the audio signal processing section 16 via the audioinput/output control section 28 and processed in the audio signalprocessing section 16, and the resulting audio signal is supplied to theaudio output section 5 to be outputted to the user as sound.

The speech synthesis section 29 generates an audio signal for a readspeech described below, for example.

The display apparatus 1 further includes an illumination section 4 andan illumination control section 18. The illumination section 4 is formedby the lighting section 4 a illustrated in FIG. 1 and a lighting circuitfor allowing the lighting section 4 a (e.g., the LED) to emit light.Based on the instruction issued from the system controller 10, theillumination control section 18 causes the illumination section 4 toperform a lighting operation.

Because the lighting section 4 a in the illumination section 4 isarranged to illuminate a scene ahead of the user as illustrated in FIG.1, the illumination section 4 performs an operation of providingillumination in a direction in which the user sees.

The display apparatus 1 includes, as units for acquiring outside worldinformation, a surrounding environment sensor 19, an imaging objectsensor 20, a GPS receiver section 21, a date/time calculation section22, an image analysis section 17, and the communication section 26.

Specific examples of the surrounding environment sensor 19 include anillumination sensor, a temperature sensor, a humidity sensor, and anatmospheric pressure sensor. The surrounding environment sensor 19 is asensor for obtaining information for detecting the brightness,temperature, humidity, weather, or the like of surroundings, as thesurrounding environment of the display apparatus 1.

The imaging object sensor 20 is a sensor for detecting informationconcerning an imaging object, i.e., a subject of an imaging operation inthe imaging section 3. Examples of the imaging object sensor 20 include:a distance-measuring sensor for detecting information on a distance fromthe display apparatus 1 to the imaging object; and a sensor (e.g., aninfrared sensor such as a pyroelectric sensor) for detecting informationor energy of, for example, a particular wavelength in infrared raysemitted by the imaging object. In the case of the pyroelectric sensor,it is possible to detect whether or not the imaging object is a livingbody such as a human being or an animal.

Further, a sensor (e.g., various types of UV (ultra violet) sensors) fordetecting information or energy of, for example, a particular wavelengthin ultraviolet rays emitted by the imaging object can also be supposed.In this case, it is possible, for example, to detect whether or not theimaging object is a fluorescent substance or a fluorescent body, and todetect the amount of ultraviolet rays in the outside world, which isnecessary for sunburn prevention.

The GPS receiver section 21 receives a radio wave from a GPS (globalpositioning system) satellite, and outputs information on the latitudeand longitude of the current position.

The date/time calculation section 22 serves as a so-called clock sectionto calculate the date and time (year, month, day, hour, minute, second),and outputs information on the current date and time.

The image analysis section 17 subjects the image data to image analysis.The image data is supplied to the image analysis section 17 via theimage input/output control section 27. Examples of the image datasubjected to image analysis in the image analysis section 17 include:the image data of a photographed image obtained by the imaging section 3and the imaging signal processing section 15; the image data receivedvia the communication section 26; and the image data reproduced from thestorage medium in the storage section 25. In other words, any image datainputted to the display apparatus 1 to be displayed on the displaysection 2 can be subjected to image analysis in the image analysissection 17. Then, the image analysis section 17 analyzes the image datato obtain information on the image included in the image data.

The communication section 26 performs data communication with theexternal device. Examples of the external device include various deviceshaving information processing and communication functions, such as acomputer device, a personal digital assistant (PDA), a mobile phone,video equipment, an audio system, and a tuner device.

In addition, other examples include a terminal device and a serverdevice connected to the network such as the Internet.

Further, other examples include a contactless IC card that contains anIC chip, a two-dimensional bar code such as a QR Code, and a hologrammemory. In these cases, the communication section 26 reads informationfrom these external devices.

Further, another display apparatus 1 is also conceivable as the externaldevice.

The communication section 26 may be configured to perform networkcommunication via short-range wireless communication for the networkaccess point, for example, in accordance with a system such as thewireless LAN, the Bluetooth, or the like. Alternatively, thecommunication section 26 may perform wireless communication directlywith the external device having the corresponding communicationfunction.

Information concerning the outside world for the display apparatus 1 isacquired by the surrounding environment sensor 19, the imaging objectsensor 20, the GPS receiver section 21, the date/time calculationsection 22, the image analysis section 17, and the communication section26, and the acquired information is supplied to the system controller10.

In accordance with the outside world information acquired via processingof the outside world situation determination function 10 a, the systemcontroller 10 exercises control related to the imaging operation or adisplay operation via processing of the operation control function 10 b.Specifically, the system controller 10 instructs the display controlsection 14 to control the operations of the display image processingsection 12 and the display driving section 13, selects the source of thedata to be displayed, controls a reproducing operation of the storagesection 25, or controls a communication operation of the communicationsection 26.

Note that although the surrounding environment sensor 19, the imagingobject sensor 20, the GPS receiver section 21, the date/time calculationsection 22, the image analysis section 17, and the communication section26 have been described above as the units for acquiring the outsideworld information, it is not necessary that all of these units areincluded. Also note that another sensor, such as an audio analysissection for detecting and analyzing surrounding sound may be included.

FIG. 4 shows an exemplary structure of a display apparatus 1 that doesnot have the imaging function. Note that, in FIG. 4, blocks havingcorresponding blocks in FIG. 3 are assigned the same reference numeralsas in FIG. 3, and redundant description is avoided.

The structure of FIG. 4 is different from the structure of FIG. 3 inthat the imaging section 3, the imaging signal processing section 15,the imaging control section 11, the illumination section 4, theillumination control section 18, the audio input section 6, and theimaging object sensor 20 are omitted.

In the case of the exemplary structure of FIG. 3 described above, thereare three possible sources of the data to be displayed on the displaysection 2: an imaging function system (i.e., the imaging section 3, theimaging signal processing section 15, and the imaging control section11), a reproducing function system (i.e., the storage section 25), and areceiving function system (i.e., the communication section 26).Meanwhile, in the case of the exemplary structure of FIG. 4, there aretwo possible sources of the data to be displayed on the display section2: the reproducing function system (i.e., the storage section 25) andthe receiving function system (i.e., the communication section 26).

In other words, FIG. 3 corresponds to the case where the displayapparatus 1 contains three types of sources of display images, whereasFIG. 4 corresponds to the case where the display apparatus 1 containstwo types of sources of the display images.

In the latter case, the image data to be subjected to image analysis inthe image analysis section 17 is the image data received via thecommunication section 26 or the image data reproduced from the storagemedium in the storage section 25.

Although not shown in the figures, there are other possible structuresof the display apparatus 1 than those illustrated in FIGS. 3 and 4. Forexample, as the source(s) of the display images within the displayapparatus 1, the display apparatus 1 may have only the imaging functionsystem, only the reproducing function system, only the receivingfunction system, the imaging function system and the reproducingfunction system, or the imaging function system and the receivingfunction system.

[3. Exemplary Displays]

As a result of the system controller 10 exercising control related tothe display operation in accordance with the acquired outside worldinformation to, for example, selecting the source of the data to bedisplayed or processing the display image, the user is able to viewvarious images in various display modes displayed on the display section2. Various exemplary displays will now be described below with referenceto FIGS. 5 to 12.

(a) of FIG. 5 illustrates a case where the display section 2 is in thethrough state. At this time, the display section 2 is in a state ofbeing simply a transparent plate, and the user is able to view a scenewithin his or her field of vision through the transparent displaysection 2.

(b) of FIG. 5 illustrates a state in which the image photographed by theimaging section 3 is being displayed on the display section 2. Thedisplay section 2 will enter this state if, when the display section 2is in the state as illustrated in (a) of FIG. 5, the imaging section 3,the imaging signal processing section 15, the display image processingsection 12, and the display driving section 13 operate to display thephotographed image on the display section 2 in a regular manner, forexample. The photographed image (i.e., a regular photographed image)displayed on the display section 2 in this case is nearly the same as ascene the user would view through the display section 2 in the throughstate. That is, in this state, the user views a photographed image thatrepresents a regular scene within his or her field of vision.

(c) of FIG. 5 illustrates a case where the system controller 10 hascontrolled the imaging control section 11 to control the imaging section3 to take a telephoto, and a telephoto image is being displayed on thedisplay section 2.

Although not shown in the figures, if the system controller 10 controlsthe imaging control section 11 to control the imaging section 3 to takea wide-angle photograph, a wide-angle image of a scene nearby will bedisplayed on the display section 2. Note that telephoto/wide-anglecontrol can be achieved by drive control of the zoom lens in the imagingsection 3 as well as by signal processing in the imaging signalprocessing section 15.

While (b) and (c) of FIG. 5 illustrate exemplary cases where the sourceof the image displayed on the display section 2 is the imaging functionsystem, FIG. 6 illustrates exemplary cases where the source of the imagedisplayed on the display section 2 is the storage section 25.

(a) of FIG. 6 illustrates an exemplary case where an image content suchas the video or the still image is stored in the storage medium in thestorage section 25, and the image content reproduced therefrom is beingdisplayed on the display section 2.

(b) of FIG. 6 illustrates an exemplary case where the game program isstored in the storage medium in the storage section 25, and the imagebased on the game program is being displayed on the display section 2.

(c) of FIG. 6 illustrates an exemplary case where an electronic bookcontent is stored in the storage medium in the storage section 25, andthe electronic book content reproduced therefrom is being displayed onthe display section 2.

As illustrated in (a), (b), and (c) of FIG. 6, the user is able to usethe display apparatus 1 to enjoy the reproduced image of the data storedin the storage medium.

Next, FIG. 7 and FIG. 8 illustrate exemplary cases where the source ofthe image displayed on the display section 2 is the communicationsection 26.

FIG. 7 illustrates exemplary cases where images transmitted from theexternal imaging apparatus 70 and received by the communication section26 via communication as illustrated in (b) of FIG. 2 or (d) of FIG. 2are being displayed.

(a) of FIG. 7 illustrates an exemplary case where, when the user isviewing the scene as illustrated in (a) of FIG. 5, i.e., when the useris in a seat in a stadium and is watching a soccer game, for example,video photographed by an imaging apparatus 70 placed at a differentplace in the stadium is received by the communication section 26 and isbeing displayed on the display section 2. For example, the imagingapparatus 70 may be placed near a seat for a team coach, or asmall-sized imaging apparatus 70 may be worn by a referee. In such acase, if video transmitted from such an imaging apparatus 70 is receivedand is displayed on the display section 2, the user is able to enjoywatching the game more fully.

(b) of FIG. 7 illustrates an exemplary case where video photographed byan imaging apparatus 70 placed at a resort or an imaging apparatus 70carried by an acquaintance who is traveling has been received by thecommunication section 26 and is being displayed on the display section2. As a result of such video being displayed on the display section 2,the user, being at home, for example, is able to enjoy watching videophotographed in various areas.

(c) of FIG. 7 illustrates an exemplary case where ground video(bird's-eye view video) photographed by an imaging apparatus 70 mountedon an airplane or a satellite has been received by the communicationsection 26 and is being displayed on the display section 2. As a resultof such video being displayed on the display section 2, the user is ableto enjoy watching a scene that normally cannot be viewed.

FIG. 8 illustrates exemplary cases where images transmitted from theexternal content source device 71 and received by the communicationsection 26 via communication as illustrated in (c) of FIG. 2 or (d) ofFIG. 2 are being displayed.

(a) of FIG. 8 illustrates an exemplary case where an image content suchas video or a still image has been received from the content sourcedevice 71 such as AV equipment, a personal computer, or the like, andthe received image content is being displayed on the display section 2.

(b) of FIG. 8 illustrates an exemplary case where the content sourcedevice 71 such as the personal computer or the like has transmittedimage data of a browser screen of a web site being accessed or a screenof a running application to the display apparatus 1, for example, andthe display apparatus 1 has received the transmitted image data via thecommunication section 26 and is displaying the received image data onthe display section 2.

(c) of FIG. 8 illustrates an exemplary case where the content sourcedevice 71 such as the personal computer or the like has transmitted animage of a list of photograph images that can be viewed in the contentsource device 71 to the display apparatus 1, for example, and thedisplay apparatus 1 has received the transmitted image via thecommunication section 26 and is displaying the received image on thedisplay section 2.

As described above, the display apparatus 1 can receive, as the imageobtained from the content source device 71, the data from the AVequipment such as a video player or the information processing apparatussuch as the personal computer, and display the image, for example. Thus,the user is able to check the image or perform various operations usingthe display apparatus 1 which he or she wears.

The source of the images illustrated in FIG. 6 and the source of theimages illustrated in FIG. 8 have been assumed to be the storage section25 and the communication section 26, respectively. Note, however, thatthe images illustrated in FIG. 8 can also be conceived as imagesreproduced from the storage section 25, and that the images illustratedin FIG. 6 can also be conceived as images transmitted from the externaldevice and received by the communication section 26, for example.

With reference to FIGS. 9 to 12, processes performed on the imagesobtained from the above-described various sources (i.e., the imagingfunction system, the reproducing function system, and the receivingfunction system) and which are related to the display modes and theimage data will now be described below.

(a) of FIG. 9 illustrates a case where the display section 2 is in thethrough state.

The system controller 10 is capable of instructing the display controlsection 14 (the display image processing section 12 and the displaydriving section 13) to present a split screen display to display animage as illustrated in (b) of FIG. 9 on the display section 2. That is,it is an exemplary case where a screen of the display section 2 isdivided into areas AR1 and AR2, and the area AR1 is in the through stateor is displaying a regular image, while the area AR2 is displaying animage obtained from the storage section 25 or the communication section26 (e.g., an image of a video content that has been reproduced orreceived), for example.

(c) of FIG. 9 illustrates another exemplary split screen display, inwhich the screen of the display section 2 is divided into areas AR1,AR2, AR3, and AR4, and each of the areas displays a separate one ofimage frames extracted at intervals of a predetermined time. Forexample, the display image processing section 12 is caused to extractframes from the image data at intervals of 0.5 seconds, and displayimages of the extracted frames sequentially in the areas in thefollowing order: AR1→AR2→AR3→AR4→AR1→AR2 and so on. This is an examplein which so-called stroboscopic display of images is achieved by thesplit screen display on the display section 2.

Needless to say, different areas of the screen may display imagesobtained from different sources.

(a) of FIG. 10 illustrates a case where an image obtained from theimaging function system, the reproducing function system, or thereceiving function system is being displayed on the display section 2 ina normal size.

At this time, the system controller 10 is capable of instructing thedisplay image processing section 12 via the display control section 14to perform an image magnification process to display a magnified imageas illustrated in (b) of FIG. 10 on the display section 2.

(a) of FIG. 11 illustrates a case where an image obtained from theimaging function system, the reproducing function system, or thereceiving function system is being displayed on the display section 2 ina regular manner.

It is assumed that this display image is an image with low brightness,which cannot be viewed by the user comfortably.

In such a case, the system controller 10 is capable of instructing thedisplay control section 14 (the display image processing section 12 andthe display driving section 13) to increase the brightness or controlthe contrast or sharpness, for example, to display a clearer image asillustrated in (b) of FIG. 11 on the display section 2.

(a) of FIG. 12 illustrates a case where an image obtained from theimaging function system, the reproducing function system, or thereceiving function system is being displayed on the display section 2 ina regular manner, or a case where the display section 2 is in thethrough state. In this image, a boundary between a shady region and asunny region appears on a pitch in the soccer stadium, for example,resulting in poor visibility.

The system controller 10 instructs the display image processing section12 to increase the display brightness of pixels in an area correspondingto the shady region and decrease the display brightness of pixels in anarea corresponding to the sunny region, for example, to display an imageas illustrated in (b) of FIG. 12 in which influence of the sunny andshady regions on the poor visibility is reduced.

(c) of FIG. 12 illustrates an exemplary display in which a specifiedobject (i.e., a bird in this example) included in an image ishighlighted so that the specified object will stand out in the image.

When the image is displayed such that the bird detected in the image ishighlighted, it is easy for the user to find the bird, i.e., an exampleof the specified object.

There are various possible methods for highlighting the specified objectin the image, such as: a method of increasing the brightness of only apart of the image on which attention should be concentrated; a method ofdecreasing the brightness of the other parts of the image than the parton which attention should be concentrated; and a method of displayingthe part of the image on which attention should be concentrated in colorand the other parts of the image in black and white. Alternatively, aspecified part of the image may be highlighted by displaying ahighlighting frame or cursor, a pointer mark, or some other characterimage at the part of the image on which attention should beconcentrated.

Although various exemplary displays have been described above, they aresimply examples. In the present embodiment, various display modes can beachieved by selection of the source (i.e., the imaging function system,the reproducing function system, or the receiving function system),control of the operations of the imaging function system and thereproducing function system, and control of the processing andoperations of the display image processing section 12 and the displaydriving section 13.

In the case where the source of the display image is the imagingfunction system, for example, the following types of display arepossible, for example: telephotographic display; wide-angle display;display involving zooming in and zooming out; magnified display; reduceddisplay; display involving variable control of the frame rate (e.g.,imaging with a high frame rate or a low frame rate); high-brightnessdisplay; low-brightness display; display involving variable control ofthe contrast; display involving variable control of the sharpness;display with increased imaging sensitivity; display with increasedinfrared imaging sensitivity; display with increased ultraviolet imagingsensitivity; and display of an image in which a particular wavelengthrange is cut off.

In the case where the source of the display image is the reproducingfunction system or the receiving function system, the following types ofdisplay are possible, for example: image display involving variablespeed playback, such as fast playback, slow playback, frame-by-frameplayback, or the like; and the same types of display that is achieved inthe personal computer or the like, such as switching of a display page,scrolling, and the like.

It is also conceivable that the processing by the display imageprocessing section 12 achieves display of an effect-applied image, suchas a mosaic image, a brightness-reversed image, a soft-focus image, animage with a part of the image highlighted, an image with overall coloratmosphere varied, or an image to which any combination of the aboveeffects is applied.

Further, a great variety of other display modes are also conceivablesuch as: split screen display that combines some types of image displaymentioned above; split screen display that combines the through stateand the photographed image (or the reproduced image or the receivedimage); and still image display in which display of one frame of thephotographed image (or the reproduced image or the received image) iscaused to continue.

[4. Detection of Outside World Information]

As described above, the display apparatus 1 according to the presentembodiment has, as the units for acquiring the outside worldinformation, the surrounding environment sensor 19, the imaging objectsensor 20, the GPS receiver section 21, the date/time calculationsection 22, the image analysis section 17, and the communication section26.

Examples of the surrounding environment sensor 19 include theillumination sensor, the temperature sensor, the humidity sensor, andthe atmospheric pressure sensor.

The illumination sensor is capable of detecting information on thebrightness of the surroundings of the display apparatus 1.

The temperature sensor, the humidity sensor, and the atmosphericpressure sensor are capable of obtaining information for determining thetemperature, the humidity, the atmospheric pressure, or the weather.

By using these surrounding environment sensors 19, the display apparatus1 is able to determine the brightness of the surroundings or, whenlocated outdoors, weather conditions or the like. Accordingly, thesystem controller 10 is able to use such information as the outsideworld information to control the display operation appropriately inaccordance with the brightness or weather conditions of thesurroundings.

In the case of the structure as illustrated in FIG. 3, the displayapparatus 1 includes the imaging object sensor 20 for detecting theinformation concerning the imaging object. Examples of the imagingobject sensor 20 include the distance-measuring sensor and thepyroelectric sensor, and in these cases, it is possible to obtain thedistance to the imaging object or information for identifying theimaging object itself.

By detecting the distance to the imaging object, the system controller10 is able to control the display operation in accordance with thedetected distance. By detecting that the imaging object is a living bodysuch as a human being, the system controller 10 is able to control thedisplay operation in accordance with the imaging object.

The GPS receiver section 21 acquires the information on the latitude andlongitude of the current position. When the latitude and longitude hasbeen detected, it is possible to obtain information concerning a place(or the neighborhood of a place) at the current position by referring toa map database or the like. Although no particular mention has been madewhen describing the structures of FIGS. 3 and 4, as a storage mediumthat the system controller 10 is able to refer to, for example, astorage medium having a relatively large capacity such as an HDD (harddisk drive), flash memory, or the like may be included, and this storagemedium may store the map database. This makes it possible to acquireinformation related to the current position.

It is not necessary, however, that the display apparatus 1 contain themap database. For example, the display apparatus 1 may access a networkserver or a device that contains the map database via the communicationsection 26, transmit the latitude and longitude of the current positionthereto to request the information related to the current position, andreceive the information.

Examples of the information related to the current position include nameinformation such as a name of a place, a name of a structure, a name ofa facility, a name of a store, and a name of a station at or near thecurrent position.

Other examples of the information related to the current positioninclude information representing the type of a structure such as a park,a theme park, a concert hall, a theater, a movie theater, a sportsfacility, or the like.

Other examples of the information related to the current positioninclude information on the type or name of a natural object, such as aseashore, a sea, a river, a mountainous region, a mountain peak, aforest, a lake, a plain, or the like.

Further, as more detailed position information, it is possible toacquire information on an area within the theme park, the stands in aballpark, the soccer stadium, or the like, seats in the concert hall,and the like as the information concerning the current position.

By acquiring the information concerning the current position, the systemcontroller 10 is able to control the display operation in accordancewith geographical conditions or facilities at or near the currentposition.

The date/time calculation section 22 calculates the date and time (year,month, day, hour, minute, second), for example. By using the date/timecalculation section 22, the system controller 10 is able to recognizethe current time, whether it is day or night now, the month, a season,and the like. Accordingly, the system controller 10 is able to controlthe display operation appropriately in accordance with whether it is dayor night (i.e., the time) or in accordance with the current season, forexample.

The image analysis section 17 is capable of detecting the followingvarious types of information from the input image data, such as thephotographed image, the received image, or the reproduced image.

First, it is possible to identify a person, an animal, a natural object,a structure, a device, and the like included in the image of the imagedata supplied from any of the sources. Regarding the animal, forexample, it is possible to recognize a situation in which a bird isincluded in the image, a situation in which a cat is included in theimage, and so on. Regarding the natural object, it is possible toidentify a sea, a mountain, a tree, a river, a lake, the sky, the sun,the moon, and so on. Regarding the structure, it is possible to identifya house, a building, a stadium, and so on. Regarding the device, it ispossible to recognize a situation in which a personal computer,audiovisual (AV) equipment, a mobile phone, a PDA, an IC card, atwo-dimensional bar code, or the like is included in the image. In thecase where an object to be analyzed is the data of the imagephotographed by the imaging section 3 or the data of the imagephotographed by the external imaging apparatus 70, for example, it ispossible to determine whether or not any of the above specified objectsis the imaging object.

Identification of the type of such a specified object is possible byregistering characteristics of the shapes of the various types ofobjects beforehand, and determining whether the input image dataincludes an object that coincides in shape with any of the various typesof objects.

The image analysis performed by the image analysis section 17 is able todetect a motion, e.g., a quick motion, of an object in the image using amethod of detecting differences between adjacent frames of the image. Inthe case where the image analyzed is an image of a sport or an image ofa car or the like that is moving, for example, it is possible to detecta situation in which an object that moves fast is included in the image.

In addition, in the case where the data of the image photographed by theimaging section 3 is subjected to image analysis in the image analysissection 17, it is also possible to determine surrounding conditions. Forexample, it is possible to determine brightness conditions, which variesdepending on whether it is day or night now and depending on theweather, and it is also possible to recognize the intensity of rain andthe like.

In addition, the image analysis performed by the image analysis section17 is able to determine that a book, a newspaper, a letter image, or thelike is included in the input image data, such as the photographedimage, the received image, the reproduced image, or the like. This isachieved by performing character recognition in the image, orrecognizing the shape of the book, the newspaper, or the like, forexample.

In the case where the image analysis section 17 has performed thecharacter recognition, the system controller 10 is able to supply arecognized letter to the speech synthesis section 29 as text data.

In addition, in the case where the image data includes a person, theimage analysis performed by the image analysis section 17 is able toidentify the person based on the face of the person. As is known, humanfaces can be analyzed to obtain information on relative positions offace components, and this information can be used as personalcharacteristic data. For example, a ratio (Ed/EN) of a distance Edbetween eyes to a distance EN between the center of an eye and a nose,and a ratio (Ed/EM) of the distance Ed between the eyes to a distance EMbetween the center of the eye and a mouth are known to be informationthat is particular to each individual and is not affected by changes inappearance caused by hair style, a worn object such as spectacles, orthe like. It is also known that these ratios are not changed by aging.

Thus, in the case where a face of a certain person is included in theimage data, the image analysis section 17 is able to analyze the imagedata to detect the personal characteristic data as described above.

Suppose that the display apparatus 1 includes, as the storage mediumthat the system controller 10 is capable of referring to, for example,the hard disk drive (HDD), the flash memory, or the like, and that apeople database is stored in this storage medium. In this case, when thepersonal characteristic data is detected from the image data, it ispossible to acquire information of an individual included in the imagedata. However, it is not necessary that the display apparatus 1 containthe people database. For example, the display apparatus 1 may access thenetwork server or a device that contains the people database, forexample, via the communication section 26, transmit the personalcharacteristic data thereto to request the information, and receive theinformation on the particular person.

For example, the user may register personal information on a person withwhom the user met in the past, such as the name, position, or the likeof that person, in the people database together with the personalcharacteristic data of that person. In this case, when this person isincluded in the image data, the system controller 10 is able to retrievethe information on this person.

Further, people database in which information on celebrities and thepersonal characteristic data of the celebrities are registered may beprepared. In this case, when any of the celebrities is included in theimage data, the system controller 10 is able to retrieve information onthat celebrity.

The communication section 26 is able to acquire various types ofinformation as the outside world information.

For example, the communication section 26 is able to acquire informationthat has been retrieved in the external device in accordance with thelatitude and longitude of the current position, the personalcharacteristic data, or the like transmitted from the display apparatus1 as described above.

Further, the communication section 26 is able to acquire, from theexternal device, information concerning the weather conditions, such asweather information, temperature information, humidity information, orthe like.

Still further, the communication section 26 is able to acquire, from theexternal device, information concerning use of a facility, informationon whether photography is prohibited or permitted in the facility, guideinformation, or the like.

Still further, the communication section 26 is able to acquireidentification information on the external device. Examples of theidentification information on the external device include a type, adevice ID, and the like of a device that is identified as a networkdevice in a predetermined communications protocol.

Still further, the communication section 26 is able to acquire imagedata stored in the external device, image data reproduced or displayedin the external device, image data received by the external device, andso on.

Examples of the information that can be acquired by each of thesurrounding environment sensor 19, the imaging object sensor 20, the GPSreceiver section 21, the date/time calculation section 22, the imageanalysis section 17, and the communication section 26 have beendescribed above. Some types of outside world information may be detectedby two or more of the above units.

For example, a combination of the information on the humidity or thelike acquired by the surrounding environment sensor 19 and the weatherinformation received by the communication section 26 can be used torecognize the current weather more precisely.

Further, a combination of the information concerning the currentposition acquired by the operations of the GPS receiver section 21 andthe communication section 26 and the information acquired by the imageanalysis section 17 can be used to recognize the conditions of thecurrent position or the imaging object more precisely.

[5. Various Exemplary Operations]

In the display apparatus 1 according to the present embodiment, thesystem controller 10 exercises control related to the display operationin accordance with the outside world information that can be acquiredvia the surrounding environment sensor 19, the imaging object sensor 20,the GPS receiver section 21, the date/time calculation section 22, theimage analysis section 17, or the communication section 26 as describedabove to present an appropriate or entertaining display in accordancewith the situation on the display section 2. Thus, a variety of imagescan be provided to the user.

Various exemplary operations for achieving the above based on thecontrol exercised by the system controller 10 will now be describedbelow.

FIG. 13 illustrates a control procedure performed by the systemcontroller 10 as the operation control function 10 b.

At step F101, the system controller 10 controls the display controlsection 14 to cause the display section 2 to enter the through state.When the display apparatus 1 is in an initial stage, i.e., when power ofthe display apparatus 1 has been turned on, for example, the systemcontroller 10 controls the display section 2 to enter the through stateat step F101.

While the display section 2 is in the through state, the systemcontroller 10 continues to check whether or not a display start triggerhas occurred at step F102. Although not illustrated in FIG. 3 or 4, forexample, a user-operable operation unit may be included so that the usercan operate a predetermined operation unit to cause the display section2 to start displaying. When the user has operated this predeterminedoperation unit, the system controller 10 may determine that the displaystart trigger has occurred, for example. Note, however, that the systemcontroller 10 may determine that the display start trigger has occurredbased on the outside world information. Specific examples thereof willbe provided later.

If it is determined that the display start trigger has occurred, thesystem controller 10 proceeds to step F103, and performs display startcontrol. That is, the system controller 10 instructs the display controlsection 14 to control the display image processing section 12 and thedisplay driving section 13 to display the supplied data on the displaysection 2 in the mode of the regular photographed image.

The image data is supplied to the display image processing section 12via the image input/output control section 27. In the case where aplurality of sources of the image data as illustrated in FIGS. 3 and 4are included, for example, it may be so arranged that, at this point,the image data is supplied from one of the imaging function system(i.e., the imaging section 3 and the imaging signal processing section15), the reproducing function system (i.e., the storage section 25), andthe receiving function system (i.e., the communication section 26) thatis selected as a default source to the display image processing section12. In the case where the imaging function system is selected as thedefault source, for example, the system controller 10, at the time ofthe display start control at step F103, issues an instruction to startimaging to the imaging control section 11 and causes the imaging section3 and the imaging signal processing section 15 to perform a regularimaging operation, and causes the resulting imaging signal (i.e., theimage data) to be supplied to the display image processing section 12via the image input/output control section 27. In this case, the displaysection 2 switches from the through state as illustrated in (a) of FIG.5, for example, to the state in which the regular photographed image isdisplayed as illustrated in (b) of FIG. 5, for example.

Meanwhile, in the case where the storage section 25 is selected as thedefault source, the system controller 10, at the time of the displaystart control, may control the storage section 25 as well and cause thedisplay section 2 to display a menu screen for reproduction of thecontent, selection of the content, and the like. Meanwhile, in the casewhere the communication section 26 is selected as the default source,the system controller 10, at the time of the display start control, maycontrol the operation of the communication section 26 as well and causethe display section 2 to display a screen to be used for communicationor present a display based on the data received from the externaldevice.

Needless to say, in the case where the display apparatus 1 has only onesource of the image data, the image data may be supplied from thatsource to the display image processing section 12.

Further, it is possible that, at the time of the display start controlat step F103, the supply of the image data from the image source is notcarried out and that the system controller 10 control a menu screen, asource selection screen, or the like to be displayed on the displaysection 2 as an initial screen.

Although an operation of outputting audio via the audio output section 5is not described in this description of the procedure of FIG. 13, itshould be noted that, when the display section 2 performs the displayoperation, the system controller 10 may control the audio input/outputcontrol section 28 and the audio signal processing section 16 to carryout the output of the audio based on the audio data supplied from thesame source as that of the display image.

While the display section 2 is displaying an image obtained from acertain source, the system controller 10 monitors whether or not adisplay control trigger has occurred at step F104, monitors whether ornot a source switch trigger has occurred at step F105, and monitorswhether or not a display termination trigger has occurred at step F106.

Occurrence of the display control trigger means that, based on theoutside world situation determined by the outside world situationdetermination function 10 a, the system controller 10 itself decides tomake a change to processing related to the mode of the display image inthe display operation or the image data to be displayed, for example.

Occurrence of the source switch trigger means that, in the case wherethe display apparatus 1 includes a plurality of sources as illustratedin FIGS. 3 and 4, for example, the system controller 10 itself decidesto switch the source of the image data to be displayed, based on theoutside world situation determined by the outside world situationdetermination function 10 a.

Specific examples of manners for determining whether the display controltrigger or the source switch trigger has occurred and specific examplesof control will be described later.

The display termination trigger is a trigger that initiates terminationof the displaying of the display section 2 and switching of the displaysection 3 to the through state. The system controller 10 may determinethat the display termination trigger has occurred based on a useroperation (a predetermined operation for terminating the displaying),for example. In addition, the system controller 10 may determine thatthe display termination trigger has occurred based on the outside worldinformation. Examples thereof will be described later.

If it is determined that the display control trigger has occurred, thesystem controller 10 proceeds from step F104 to step F107, and performscontrol related to the operation of displaying the image. That is, thesystem controller 10 issues a predetermined instruction to the displaycontrol section 14 to cause the display section 2 to present a displayin a mode appropriate for the outside world situation at the time.Depending on the source selected at the time, the system controller 10may perform control of the imaging function system, operation controlrelated to the storage section 25, or operation control related to thecommunication section 26.

After performing the control of the display operation at step F107, thesystem controller 10 monitors the occurrence of the triggers at stepsF104, F105, and F106.

If it is determined that the source switch trigger has occurred, thesystem controller 10 proceeds from step F105 to step F108, and performssource switch control. In this case, the system controller 10 performsoperation control related to the source that is being selected beforesource switching and the source that will be selected after sourceswitching, and controls the image input/output control section 27 and/orthe audio input/output control section 28 so that the image data and/orthe audio data will be supplied from the newly selected source to thedisplay image processing section 12 and/or the audio signal processingsection 16.

As a result of the performance of this source switch control, the stateof the display section 2 is switched from a state in which the imagephotographed by the imaging section 3 is being displayed to a state inwhich the image reproduced in the storage section 25 is being displayed,for example.

After performing the source switch control at step F108, the systemcontroller 10 monitors the occurrence of the triggers at steps F104,F105, and F106.

If it is determined that the display termination trigger has occurred,the system controller 10 returns from step F106 to step F101, andinstructs the display control section 14 to cause the display section 2to enter the through state. In addition, the system controller 10instructs the image source selected at the time to terminate theoperation of supplying the image.

While the user is wearing the display apparatus 1 and keeping the powerthereof on, the operation control function 10 b of the system controller10 continues to perform the control procedure as illustrated in FIG. 13,for example.

According to this procedure, the display start control is performed whenit is determined that the display start trigger has occurred; displaymode control is performed when it is determined that the display controltrigger has occurred; the source switch control is performed when it isdetermined that the source switch trigger has occurred; and control ofterminating the displaying of the display section 2 and causing thedisplay section 2 to enter the through state is performed when it isdetermined that the display termination trigger has occurred. Specificexamples of the manners for determining whether these triggers haveoccurred and specific examples of control will now be described belowwith reference to FIG. 14 and subsequent figures.

FIGS. 14 to 23 illustrate exemplary procedures performed by the systemcontroller 10 as the outside world situation determination function 10a. It is assumed that these procedures are performed in parallel withthe procedure of FIG. 13 performed by the operation control function 10b. The parallel processing is achieved, for example, by detectionprocedures as illustrated in FIGS. 14 to 23 being regularly handled asinterrupts while the system controller 10 is performing the procedure ofFIG. 13. Programs for the procedures as illustrated in FIGS. 13 to 19may either be incorporated in a program for executing the procedure ofFIG. 13, or be separate programs that are called up regularly. That is,the forms of the programs are not limited.

FIGS. 14 to 21 illustrate exemplary procedures related to thedetermination of the occurrence of the display control trigger performedat step F104 in FIG. 13. First, with reference to FIG. 14, an exemplaryprocedure for determining the occurrence of the display control triggerbased on the information obtained from the surrounding environmentsensor 19 or the image analysis section 17 will now be described below.

At step F201 in FIG. 14, the system controller 10 monitors one or bothof the information obtained by the surrounding environment sensor 19 andthe information obtained by the image analysis section 17. It is assumedhere that the surrounding environment sensor 19 is the illuminationsensor, and that the image analysis section 17 is performing a processof analyzing the photographed image to determine the brightness of thesurroundings.

Note that in the structure of FIG. 4, the image analysis section 17 isnot capable of analyzing data of a photographed image of a place nearbyunless the external imaging apparatus 70 is placed nearby, and thereforethe system controller 10 normally checks only the surroundingenvironment sensor 19.

Based on one or both of the information obtained from the surroundingenvironment sensor 19 and the information obtained from the imageanalysis section 17, the system controller 10 determines whether or notit is dark in the surroundings, or whether or not it is too bright inthe surroundings. For example, detected illumination is converted intonumerical form, and when the detected illumination is lower than x lux,the system controller 10 determines that it is dark in the surroundings,and when the detected illumination is higher than y lux, the systemcontroller 10 determines that it is too bright in the surroundings.

If it is determined that it is dark in the surroundings, the systemcontroller 10 proceeds from step F202 to step F204, and determines thatthe display control trigger has occurred. Then, at step F205, the systemcontroller 10 calculates an adjustment value in accordance with thecurrent illumination (darkness) in the surroundings. For example, anadjustment value for the display brightness, the contrast, thesharpness, or the like is calculated.

If it is determined that it is too bright in the surroundings, thesystem controller 10 proceeds from step F203 to F206, and determinesthat the display control trigger has occurred. Then, at step F207, thesystem controller 10 calculates an adjustment value for the displaybrightness, the contrast, the sharpness, or the like in accordance withthe current illumination in the surroundings.

As a result of processes of steps F204 and F205 or processes of stepsF206 and F207, control in the procedure of FIG. 13 performed by thesystem controller 10 proceeds from step F104 to step F107, and in thiscase, the system controller 10 instructs the display image processingsection 12 to perform a process such as the brightness control, thecontrast control, or the sharpness control.

As a result of this process, the image quality of the image displayed onthe display section 2 is adjusted, so that an image adjusted inaccordance with the brightness of the surroundings is displayed thereon.As an example of adjustment in accordance with the brightness of thesurroundings, it is conceivable that, in the case where the screen isdivided such that the photographed image of the video content or thelike is displayed in a part of the screen while the remaining part ofthe screen is in the through state or is displaying the regularphotographed image (i.e., the image of the outside scene viewed by theuser) as illustrated in (b) of FIG. 9, for example, the image quality ofthe image of the video content is adjusted. For example, the imagequality of the image of the video content is adjusted so that thethrough part of the screen and the image of the video content arebalanced in terms of brightness, and that the user might not feeluncomfortable in viewing. In the case where it is dark in thesurroundings and therefore the through part of the screen is dark, forexample, the image quality of the video content may accordingly becaused to decrease in brightness so as not to be too dazzling.Conversely, in the case where it is bright in the surroundings andtherefore the brightness of the through part of the screen is high, forexample, the image quality of the video content may be caused toincrease in brightness, or the contrast or sharpness may be enhanced sothat visibility will be improved. Alternatively, the through part of thescreen may be caused to decrease in transmissivity.

Further, even if the split screen display is not being performed, thedisplay on the screen of the display section 2 is affected by outsidelight when the received image obtained from the communication section 26or the reproduced image obtained from the storage section 25 is beingdisplayed on the display section 2. Therefore, it is preferable that thedisplay brightness, the contrast, the sharpness, or the like be adjustedin accordance with the brightness of the surroundings so that the usercan view the image more clearly.

In the case where the photographed image obtained from the imagingfunction system is being displayed on the display section 2, if it isdark in the surroundings, the display brightness, the contrast, and thesharpness may be caused to increase so that the user can view thesurroundings more clearly via the image displayed on the display section2. For example, it is conceivable that when it is dark in thesurroundings and thus the display image on the display section 2 is inthe state as illustrated in (a) of FIG. 11, the adjustment is performedto achieve the good-visibility state as illustrated in (b) of FIG. 11.

Note that in the case where it has been determined that it is dark inthe surroundings, the system controller 10 may control the illuminationsection 4 to provide illumination.

In the case where the image obtained from the imaging function system isbeing displayed on the display section 2 and it is too bright in thesurroundings, the display brightness may be caused to decrease so thatthe user might not feel his or her eyes dazzled.

FIG. 15 illustrates an exemplary procedure for determining theoccurrence of the display control trigger based on the informationobtained from the surrounding environment sensor 19 or the informationobtained from the communication section 26.

At step F301 in FIG. 15, the system controller 10 monitors one or bothof the information detected by the surrounding environment sensor 19 andthe information received by the communication section 26. Examples ofthe surrounding environment sensor 19 include the temperature sensor,the humidity sensor, and the atmospheric pressure sensor. It is assumedhere that the communication section 26 regularly receives the weatherinformation from the network server or the like, for example.

The system controller 10 is able to determine the weather conditions ofthe surroundings based on the information on the atmospheric pressure,the humidity, and the temperature obtained by the surroundingenvironment sensor 19, for example. In addition, the system controller10 is able to determine the weather conditions based on the weatherinformation received by the communication section 26. Note that, inorder to receive the information on the weather conditions from thenetwork server, the system controller 10 may transmit the information onthe current position obtained by the GPS receiver section 21 regularlyto the network server to receive, from the network server, weatherinformation on an area to which the current position belongs.

The system controller 10 is able to determine the weather conditions ofthe surroundings based on the information detected by the surroundingenvironment sensor 19 or the information received by the communicationsection 26, but use of both the information makes it possible torecognize the weather conditions more precisely.

The system controller 10 determines whether or not image adjustment isrequired in accordance with the weather conditions, such as fineweather, cloudy weather, rainy weather, a thunderstorm, a typhoon, or asnowfall, or a change in the weather conditions, such as start ofrainfall, stopping of rainfall, or darkening of the sky. If it isdetermined that the image adjustment is required, the system controller10 proceeds from step F302 to step F303, and determines that the displaycontrol trigger has occurred. Then, at step F304, the system controller10 calculates an adjustment value in accordance with the currentweather. For example, an adjustment value for the display brightness,the contrast, the sharpness, color processing, or the like iscalculated.

As a result of processes of steps F303 and F304, control in theprocedure of FIG. 13 performed by the system controller 10 proceeds fromstep F104 to step F107, and in this case, the system controller 10instructs the display image processing section 12 to perform a processsuch as the brightness control, the contrast control, the sharpnesscontrol, the color processing, or the like. As a result of this process,the image quality of the image displayed on the display section 2 isadjusted so as to be suitable for the weather conditions.

For example, the image quality of the image displayed on the displaysection 2 is adjusted in accordance with the brightness of thesurroundings, which varies depending on the weather, so that the userwill feel the display image on the display section 2 clearer.

In addition, it is conceivable that the image quality is adjusted so asto have an atmosphere suitable for an image of the weather. When it issnowing, for example, blue may be enhanced to display an image that issuited to an image of the temperature of the surroundings, orconversely, red may be enhanced to allow the image quality to give animpression of warmth as opposed to coldness.

Note that in the case where the display apparatus 1 has the structure asillustrated in FIG. 3 and the photographed image is being displayed onthe display section 2, the system controller 10 may control theillumination section 4 to provide illumination depending on the weather.

Also note that although it has been assumed here that the weather isdetermined based on the information obtained by the surroundingenvironment sensor 19 or the information received by the communicationsection 26, recognition of a rain image by the image analysis section 17allows accurate detection of the start or stop of rainfall, occurrenceof lightening, or the like.

Next, with reference to FIG. 16, an exemplary procedure for determiningthe occurrence of the display control trigger based on the informationobtained from the surrounding environment sensor 19 will now bedescribed below.

At step F401 in FIG. 16, the system controller 10 monitors theinformation obtained by the surrounding environment sensor 19. It isassumed here that the surrounding environment sensor 19 is composed ofthe temperature sensor and the humidity sensor.

Based on the information detected by the surrounding environment sensor19, the system controller 10 detects current temperature and humidityconditions of the surroundings, and determines whether or not thesurroundings are at high temperature and high humidity, and whether ornot the surroundings are at low temperature, for example.

If it is determined that the surroundings are at high temperature andhigh humidity, making the user feel uncomfortable, the system controller10 proceeds from step F402 to step F404, and determines that the displaycontrol trigger has occurred. Then, at step F405, the system controller10 calculates an adjustment value for the sharpness, the colorprocessing, an image effect, or the like, for example.

Meanwhile, if it is determined that the surroundings are at lowtemperature, making the user feel the cold, the system controller 10proceeds from step F403 to step F406, and determines that the displaycontrol trigger has occurred. Then, at step F407, the system controller10 calculates an adjustment value for the sharpness, the colorprocessing, the image effect, or the like, for example.

As a result of processes of steps F404 and F405 or processes of stepsF406 and F407, control in the procedure of FIG. 13 performed by thesystem controller 10 proceeds from step F104 to step F107, and thesystem controller 10 instructs the display image processing section 12to adjust the image data with respect to the display brightness, thecontrast, the sharpness, the color processing, the image effect, or thelike.

In the case where the photographed image, the reproduced image, or thereceived image is displayed, if the surroundings are at high temperatureand high humidity, for example, the above adjustment process may changethe image into an image tinted with a cool shade of blue or similarcolors, for example, and if the surroundings are at low temperature, theabove adjustment process may change the image into an image that givesan impression of warmth by a process of tinting the image with a shadeof red or similar colors, applying a soft focus effect to the image, orthe like, for example.

Note that although, in the above example, determination has been madewith respect to conditions of “high temperature and high humidity” and“low temperature,” additional determination may be made with respect toa condition of “low humidity.” For example, it may be so arranged thatit is determined whether or not the surroundings are at “hightemperature and high humidity” and whether or not the surroundings areat “low temperature and low humidity,” and that image control isperformed in accordance with the determinations. Further, for example,it may be so arranged that determination is made with respect to fourconditions of “high temperature and high humidity,” “high temperatureand low humidity,” “low temperature and high humidity,” and “lowtemperature and low humidity,” and that image control is performed inaccordance with the determinations.

FIG. 17 illustrates an exemplary procedure for determining theoccurrence of the display control trigger based on the information onthe current time obtained by the date/time calculation section 22.

At step F501 in FIG. 17, the system controller 10 checks the currentdate and time calculated by the date/time calculation section 22. Basedon the current time, the system controller 10 determines a time periodwithin which the current time falls. Examples of the time period includeearly hours, early morning, daytime, evening, and night. For example,the early hours are assumed to range from 4 to 7, the early morning from7 to 9, the daytime from 9 to 17, the evening from 17 to 19, and thenight from 19 to 4.

Note that a criterion for separating the time into the time periods maybe changed depending on the month and day. For example, considering thatsunrise and sunset differ depending on the month and day, a time rangeof any of the above time periods may be changed. For example, the timeperiod “early hours” may be determined to range from 4 to 7 in summer,and from 6 to 8 in winter.

The system controller 10 determines whether the time period of thecurrent date and time has changed, based on the time period of thecurrent time determined by the date and time check performed at stepF501. If it is determined that the time period of the current date andtime has changed, the system controller 10 proceeds from step F502 tostep F503 and subsequent steps.

For example, when the current time falls within the early hours, thesystem controller 10 proceeds from step F503 to step F507, anddetermines that a display control trigger for a display operation forthe early hours has occurred.

When the current time falls within the early morning, the systemcontroller 10 proceeds from step F504 to step F508, and determines thata display control trigger for a display operation for the early morninghas occurred.

When the current time falls within the daytime, the system controller 10proceeds from step F505 to step F509, and determines that a displaycontrol trigger for a display operation for the daytime has occurred.

When the current time falls within the evening, the system controller 10proceeds from step F506 to step F510, and determines that a displaycontrol trigger for a display operation for the evening has occurred.

When the current time falls within the night, the system controller 10proceeds to step F511, and determines that a display control trigger fora display operation for the night has occurred.

If it is determined at any of steps F507, F508, F509, F510, and F511that the display control trigger has occurred, control in the procedureof FIG. 13 performed by the system controller 10 proceeds from step F104to step F107, and the system controller 10 instructs the display controlsection 14 to perform the display operation in accordance with thecurrent time period. For example, the system controller 10 instructs thedisplay control section 14 to perform a process such as the displaybrightness control, the contrast control, the sharpness control, colorcontrol, or the like. In addition, the system controller 10 may instructthe display control section 14 to apply an image effect, such as softfocus display.

As a result of this process, an image that gives an impression suited tothe current time period is presented to the user as the photographedimage, the reproduced image, or the received image. For example, animage having a soft image quality is presented in the early hours, asharp high-contrast image is presented in the daytime, an image having asepia-toned image quality is presented in the evening, and an imagehaving a drab image quality is presented at night. Thus, entertainingimages that match moods of the user in the respective time periods canbe presented to the user.

Needless to say, image quality control of adjusting the image quality inaccordance with the brightness of the current time period in order toimprove visibility is also conceivable.

Further, in addition to the time period, the weather conditions andwhether the user is currently indoors or outdoors may be determined toadjust the image quality appropriately in accordance with theconditions.

Still further, it may be so arranged that the season, instead of thetime period, is determined based on the information on the date andtime, and that the image quality is adjusted in accordance with theseason. For example, images with a sense of the season may be presentedto the user by, in displaying the images, enhancing blue components insummer, red components in fall, white components in winter, andgreen/pink or similar colors in spring, for example.

FIG. 18 illustrates an exemplary procedure for determining theoccurrence of the display control trigger based on the informationreceived by the GPS receiver section 21 and the information received bythe communication section 26.

At step F601 in FIG. 18, the system controller 10 transmits theinformation on the latitude and longitude of the current positionobtained by the GPS receiver section 21 to the network server or thedevice that contains the map database via the communication section 26,and receives information concerning the current position retrieved inthe network server or the device that contains the map database. Notethat in the case where the display apparatus 1 contains the mapdatabase, the system controller 10 is able to retrieve informationconcerning the current position from this map database based on theinformation on the latitude and longitude of the current positionobtained from the GPS receiver section 21.

Based on the acquired information concerning the current position, thesystem controller 10 determines whether or not the user is currently ata place where predetermined display control should be performed. If itis determined that the current position is a place where thepredetermined display control should be performed, the system controller10 proceeds from step F602 to step F603, and determines that a displaycontrol trigger for performing the predetermined display control hasoccurred.

As a result of it being determined at step F603 that the display controltrigger has occurred, control in the procedure of FIG. 13 performed bythe system controller 10 proceeds from step F104 to step F107, and thesystem controller 10 instructs the display control section 14 to performpredetermined image processing.

Examples of the display control to be performed in this case are asfollows.

Suppose, for example, that a seashore, a mountain, an urban area, arural area, or the like is identified in a region of the currentposition. In this case, the image quality of the image displayed on thedisplay section 2 may be adjusted in accordance with an image of theseashore, the mountain, the urban area, the rural area, or the like.

Also, based on the acquired information concerning the current position,a place name, the name of the facility, the store, or the like which isbeing photographed, or the like may be superimposed, in the form of acharacter image or a letter, on the image displayed on the displaysection 2. It is also conceivable that advertising information, theguide information on the facility, alarm information concerning asurrounding area, or the like is displayed on the display section 2.

It is also conceivable that the display brightness or the like iscontrolled depending on whether the user is indoors or outdoors.

Also, in the case where the bird's-eye view image as illustrated in (c)of FIG. 7 is being displayed, it is conceivable that a new image isacquired via the communication section 26 as the current positionchanges, and that the current image is replaced by the new imageacquired.

(a) of FIG. 19 illustrates an exemplary procedure for determining theoccurrence of the display control trigger based on the informationobtained from the image analysis section 17. More particularly, in thisexemplary procedure, it is determined whether or not the image dataincludes a letter. Examples of data that includes a letter include dataof an image of the newspaper, data of an image of the book, and theimage data of the electronic book as illustrated in (c) of FIG. 6.

At step F701 in (a) of FIG. 19, the system controller 10 monitors theinformation obtained from the image analysis section 17. It is assumedhere that the image analysis section 17 performs image analysis todetect whether or not the image data includes a letter.

The system controller 10 determines whether or not the image dataincludes a letter based on information on a result of the analysisperformed by the image processing section 17.

If it is determined that the image data includes a letter, the systemcontroller 10 proceeds from step F702 to step F703, and determines thatthe display control trigger has occurred.

Then, at step F704, the system controller 10 calculates an adjustmentvalue that is suited to the case where the letter image is read by theuser. For example, an adjustment value for the display brightness, thecontrast, the sharpness, or the like is calculated so that the user canread the letter displayed on the display screen comfortably.

As a result of processes of steps F703 and F704, control in theprocedure of FIG. 13 performed by the system controller 10 proceeds fromstep F104 to step F107, and in this case, the system controller 10instructs the display image processing section 12 to perform a processsuch as the brightness control, the contrast control, the sharpnesscontrol, or the like. As a result of this process, the image quality ofthe image displayed on the display section 2 is adjusted so that lettersin the image as illustrated in (c) of FIG. 6, for example, will becomeeasier to read.

Note that it may be so arranged that, in addition to detecting whetheror not the image includes a letter, the brightness of the surroundingsis detected, and that the detected brightness of the surroundings istaken into account when calculating the adjustment value.

It is also conceivable that, instead of adjusting the image quality, thedisplay image processing section 12 performs the magnification process,for example, to display the magnified image, thereby providing to theuser an image with which the user is able to read the letter easily.

In the case where the photographed image obtained from the imagingfunction system is being displayed on the display section 2, recognitionof the shape of the book or newspaper in the image analysis may be addedto a condition for proceeding to step F703. In this case, if it isdetermined that the imaging object is the newspaper or the like, thesystem controller 10 may control the illumination section 4 to provideillumination.

In the case where the image includes a letter, the image analysissection 17 may identify the letter and supply the letter to the systemcontroller 10 as text data. In this case, the system controller 10controls the speech synthesis section 29 to perform a speech synthesisprocess based on the text data detected from the image.

As a result, the audio signal for the read speech reading the letterincluded in the image data is generated in the speech synthesis section29. The system controller 10 controls the read speech to be outputtedvia the audio output section 5. As a result, the user is able to listento the read speech while viewing the image including the letterdisplayed on the display section 2.

(b) of FIG. 19 also illustrates an exemplary procedure for determiningthe occurrence of the display control trigger based on the informationobtained from the image analysis section 17. According to this exemplaryprocedure, visibility of the image data obtained from a certain sourceis improved.

At step F710 in (b) of FIG. 19, the system controller 10 monitors theinformation obtained from the image analysis section 17. The imageanalysis section 17 analyzes the image data to determine whether or notthe image is in an appropriate brightness state, or whether or not theimage has appropriate clearness.

If it is determined that the image has too low brightness or too lowclearness, the system controller 10 proceeds from step F711 to stepF712, and determines that the display control trigger has occurred.

Then, at step F713, the system controller 10 calculates an adjustmentvalue for improving the visibility. For example, an adjustment value forthe display brightness, the contrast, the sharpness, or the like iscalculated which enables the user to view the image on the displayscreen comfortably.

As a result of processes of steps F712 and F713, control in theprocedure of FIG. 13 performed by the system controller 10 proceeds fromstep F104 to step F107, and in this case, the system controller 10instructs the display image processing section 12 to perform a processsuch as the brightness control, the contrast control, the sharpnesscontrol, or the like. As a result of this process, the image quality ofthe image displayed on the display section 2 is adjusted, so that animage that is easy to see is provided to the user.

(a) of FIG. 20 also illustrates an exemplary procedure for determiningthe occurrence of the display control trigger based on the informationobtained from the image analysis section 17.

At step F801 in (a) of FIG. 20, the system controller 10 monitors theinformation obtained from the image analysis section 17. It is assumedhere that the image analysis section 17 analyzes the photographed imageto determine whether or not the image data includes a specified object.

If, as a result of the image analysis, it is determined that thephotographed image includes the specified object, the system controller10 proceeds from step F802 to step F803, and determines that the displaycontrol trigger has occurred.

As a result of it being determined at step F803 that the display controltrigger has occurred, control in the procedure of FIG. 13 performed bythe system controller 10 proceeds from step F104 to step F107, and thesystem controller 10 instructs the display control section 14 to performpredetermined image processing.

Conceivable examples of image processing control in this case are asfollows.

In the case where the specified object is a bird, for example, if a birdis detected in the image data, the system controller 10 may instruct thedisplay image processing section 12 to highlight the bird in the imageas illustrated in (c) of FIG. 12. As a result, the photographed image,the received image, or the reproduced image is displayed on the displaysection 2 in such a manner that the user can find the bird easily.Needless to say, this is not limited to the bird, but may be applied toany other animals.

In the case where the specified object is a person, if the person isdetected in the image data, the system controller 10 may instruct thedisplay image processing section 12 to allow the person to stand out inthe image by highlighting the person, or to magnify the person, forexample.

In the case where the specified object is a person, an animal, astructure, or the like, an image may be displayed in which only thespecified object is displayed while a scene surrounding the specifiedobject such as the person is blotted out entirely.

It is also conceivable that when a person is detected as the specifiedobject, the image is processed so that only the person is blotted out inthe image. For example, an image of a natural scene in which anartificial object such as a person, a car, or the like is excluded(masked) may be displayed. In this case, an interpolation process may beperformed so that pixels corresponding to the specified object will befilled in using pixels that surround the specified object that is to bemasked.

In the case where the specified object is a person or the like, it isalso conceivable to apply an image effect such as mosaic display.

(b) of FIG. 20 also illustrates an exemplary procedure for determiningthe occurrence of the display control trigger based on the informationobtained from the image analysis section 17.

At step F810 in (b) of FIG. 20, the system controller 10 monitors theinformation obtained from the image analysis section 17. The imageanalysis section 17 analyzes the photographed image to detect whether ornot a quick motion is occurring in the image data. For example, thespeed of a motion can be determined based on differences between framesof video data.

If, as a result of the image analysis, an object that moves fast isdetected, the system controller 10 proceeds from step F811 to step F812,and determines that the display control trigger has occurred.

As a result of it being determined at step F812 that the display controltrigger has occurred, control in the procedure of FIG. 13 performed bythe system controller 10 proceeds from step F104 to step F107, and thesystem controller 10 instructs the display control section 14 to performimage processing.

For example, it is conceivable that, in order to enable the user tocheck the quick motion easily, the system controller 10 instructs thedisplay control section 14 to perform image processing so that astroboscopic display as illustrated in (c) of FIG. 9 will be presented.

It is also conceivable that the system controller 10 instructs thedisplay control section 14 to perform image processing such ashighlighting or magnifying a quickly moving object to attract attentionof the user to the quickly moving object.

In the case where the reproduced image data obtained from the storagesection 25 is displayed, it is conceivable that the system controller 10instructs the storage section 25 to perform slow playback to present aslow version of the quick motion to the user.

(a) of FIG. 21 also illustrates an exemplary procedure for determiningthe occurrence of the display control trigger based on the informationobtained from the image analysis section 17. More particularly, in thisexemplary procedure, when a person has been photographed, that person isidentified.

At step F901 in (a) of FIG. 21, the system controller 10 monitors theinformation obtained from the image analysis section 17. The imageanalysis section 17 analyzes the photographed image to determine whetherthe image data includes the face of a person, and, if the photographedimage includes the face of a person, generates the personalcharacteristic data from an image of the face. As noted previously,examples of the personal characteristic data include the ratio (Ed/EN)of the distance Ed between the eyes to the distance EN between thecenter of the eye and the nose, and the ratio (Ed/EM) of the distance Edbetween the eyes to the distance EM between the center of the eye andthe mouth.

If the personal characteristic data is extracted, the system controller10 proceeds from step F902 to step F903, and searches for personalinformation based on the personal characteristic data.

For example, the system controller 10 transmits the personalcharacteristic data to the network server or the device that containsthe people database via the communication section 26, and receives aresult of search performed in the network server or the device thatcontains the people database for the personal information. In the casewhere the display apparatus 1 contains the people database, the systemcontroller 10 is able to search the people database based on thepersonal characteristic data.

If the personal information on the specified person is found as a resultof the search performed by the external device or the system controller10 itself, the system controller 10 proceeds from step F904 to stepF905, and determines that a display control trigger for displaying thepersonal information has occurred.

As a result of it being determined at step F905 that the display controltrigger has occurred, control in the procedure of FIG. 13 performed bythe system controller 10 proceeds from step F104 to step F107, and thesystem controller 10 instructs the display control section 14 to, forexample, display the retrieved personal information so as to besuperimposed on the image.

In the case where the photographed image, the reproduced image, or thereceived image being displayed includes a person whom the user met inthe past or a celebrity who is registered in the people database,information on the person or celebrity (i.e., information registered inthe people database, such as the name or position of the person orcelebrity, a place at which the user met the person, or the like) isdisplayed on the display section 2 together with an image of the personor celebrity as a result of the above process, so that the user canrecognize the person or celebrity accurately.

(b) of FIG. 21 also illustrates an exemplary procedure for determiningthe occurrence of the display control trigger based on the informationobtained from the image analysis section 17. This exemplary procedurecorresponds to the case where the image is hard to see because of theinfluence of the sunny and shady regions as illustrated in (a) of FIG.12.

At step F910 in (b) of FIG. 21, the system controller 10 monitors theinformation obtained from the image analysis section 17. The imageanalysis section 17 analyzes the image data to determine whether or notbright and dark regions are present in the image because of sunlight.

If, when the photographed image, the reproduced image, or the receivedimage is being displayed, the image analysis of the image data thereofdetermines that brightness variations are occurring in the image becauseof the presence of the sunny and shady regions, the system controller 10proceeds from step F911 to step F912, and determines that the displaycontrol trigger has occurred.

As a result of it being determined at step F912 that the display controltrigger has occurred, control in the procedure of FIG. 13 performed bythe system controller 10 proceeds from step F104 to step F107, and thesystem controller 10 instructs the display control section 14 to performimage processing for eliminating the brightness variations caused by thesunny and shady regions, e.g., a partial change in display brightnesslevel. As a result of this process, an image that is easy to see andwhich is not influenced by the sunny and shady regions significantly canbe provided to the user as illustrated in (b) of FIG. 12, for example.

It is also conceivable that, in the case where the influence of a lampin a house or a facility, for example, instead of the influence of thesunlight, causes significant partial brightness variations to occur inthe image or makes the image partially unclear, the brightness control,the imaging sensitivity control, the contrast control, or the like withrespect to a part of the image may be performed.

As the procedures of FIGS. 14 to 21, examples of the processes ofprocessing, when displaying the photographed image, the reproducedimage, or the received image, the display mode of the image to bedisplayed or the image data to be displayed in accordance with theoutside world information have been described above, but these examplesare only illustrative and not restrictive. A great variety of otherexamples are conceivable as examples of the determination of whether ornot the display control trigger has occurred or examples of control.

As for the display control trigger, the outside world situation isdetected based on the information obtained from the surroundingenvironment sensor 19, the imaging object sensor 20, the GPS receiversection 21, the date/time calculation section 22, the image analysissection 17, or the communication section 26, and if a predeterminedcondition is satisfied, it is determined that a trigger has occurred.

As examples of the control to be performed when it has been determinedbased on various conditions that the display control trigger hasoccurred, and as control to be exercised over the display imageprocessing section 12, the following types of control can be performedin accordance with the outside world situation, for example:magnification/reduction control; control of the brightness, thecontrast, the sharpness, or the like; display of an effect-appliedimage, such as the mosaic image, the brightness-reversed image, thesoft-focus image, or the like; and control of the split screen displayor the stroboscopic display as illustrated in FIG. 9.

A display mode that combines the through state and the image (i.e., thereproduced image, the received image, or the photographed image) is alsoconceivable. For example, the display section 2 may be caused to enter asemi-through state (about 50% transmissivity) while the image isdisplayed on the display section 2.

In the case where the photographed image obtained from the imagingfunction system is being displayed on the display section 2, it isconceivable that, as control of the operations of the imaging section 3and the imaging signal processing section 15, a telephoto/wide-anglezooming process, control of the imaging sensitivity, switching of theimaging frame rate, change of infrared imaging sensitivity orultraviolet imaging sensitivity, or the like is performed.

In the case where the reproduced image obtained from the storage section25 or the received image obtained from the communication section 26 isbeing displayed on the display section 2, it is conceivable that thedisplay control trigger is treated as a trigger for variable speedplayback such as fast-forwarding/fast-reversing, cueing, frame advance,slow playback and pause, and as a trigger for page advance, page scroll,moving a selection on a list being displayed, cursor movement, adeciding operation, a game operation, or the like, and that the systemcontroller 10 controls the storage section 25 or the communicationsection 26 to perform a desired operation.

That is, as conditions for determining that the display control triggerhas occurred and control in accordance therewith, any combination of theabove is conceivable.

Referring to (b) of FIG. 9, when the display on the display section 2 isswitched in response to the occurrence of the display control trigger asdescribed above, the area AR1 on the display section 2, where the screenis in the through state or the regular photographed image is beingdisplayed, may be left unchanged while an image in a different mode isdisplayed in the area AR2, i.e., a part of the display section 2.Needless to say, conversely, an image in accordance with the displaycontrol trigger may be displayed in the wider area AR1 conversely. Also,it may be so arranged that the screen is divided into two equally-sizedparts, and that the regular photographed image is displayed in one ofthe two parts while the image in accordance with the display controltrigger is displayed on the other of the two parts.

Next, with reference to FIGS. 22 and 23, exemplary procedures fordetermining the occurrence of the source switch trigger at step F105 inFIG. 13 will now be described below.

(a) of FIG. 22 illustrates an exemplary procedure for determining theoccurrence of the source switch trigger based on the analysis performedby the image analysis section 17.

At step F1001 in FIG. 22, the system controller 10 monitors theinformation obtained from the image analysis section 17. It is assumedhere that the display apparatus 1 includes the imaging function systemas illustrated in FIG. 3, and that the image analysis section 17analyzes the image data of the image photographed by the imaging section3 to detect whether or not the subject of the imaging section 3 includesan electronic device with which the display apparatus 1 is capable ofcommunicating. For example, a device, such as the personal computer, themobile phone, the AV equipment, or the PDA, with which the displayapparatus may be capable of performing data communication is identifiedbased on its appearance.

If, as a result of the image analysis, it is determined that theelectronic device has been photographed, the system controller 10proceeds from step F1002 to step F1003, and instructs the communicationsection 26 to transmit to the electronic device a request forestablishment of communication. If the electronic device photographed isa device that is capable of communicating with the display apparatus 1according to the present embodiment, a response to the request for theestablishment of communication will be obtained, so that thecommunication is established between the display apparatus 1 and theelectronic device. When it is determined that the external electronicdevice is a compatible device that is capable of communicating with thedisplay apparatus 1 as described above, the system controller 10proceeds from step F1004 to step F1005, and determines that a sourceswitch trigger for designating the communication section 26 as thesource has occurred.

As a result of it being determined at step F1005 that the source switchtrigger has occurred, control in the procedure of FIG. 13 performed bythe system controller 10 proceeds from step F105 to step F108, and thesystem controller 10 switches the image source to the communicationsection 26. As a result of this switching, the display section 2 willenter a state in which the image data received by the communicationsection 26 is displayed thereon.

The above process makes it possible, when an external device (e.g., theimaging apparatus 70 or the content source device 71 as illustrated inFIG. 2) with which the display apparatus 1 is capable of communicatingexists in the surrounding area, to display the image received from theexternal device on the display section 2.

(b) of FIG. 22 illustrates an exemplary procedure for switching thesource in response to a request transmitted from the external device ata specified place.

At step F1010 in (b) of FIG. 22, the system controller 10 transmits theinformation on the latitude and longitude of the current positionobtained by the GPS receiver section 21 to the network server or thedevice that contains the map database via the communication section 26,and receives the information concerning the current position retrievedin the network server or the device that contains the map database. Notethat in the case where the display apparatus 1 contains the mapdatabase, the system controller 10 is able to retrieve the informationconcerning the current position from this map database based on theinformation on the latitude and longitude of the current positionobtained from the GPS receiver section 21.

Based on the acquired information concerning the current position, thesystem controller 10 determines whether or not the current position iswithin a specified region or facility. if it is determined that thecurrent position is in the specified region or facility, the systemcontroller 10 proceeds from step F1011 to step F1012, and determineswhether or not a request for communication has been received from theexternal device. For example, the system controller 10 may wait for apredetermined time for the request for communication to be received fromthe external device.

If the request for communication has been received from the externaldevice, the system controller 10, at step F1013, allows thecommunication section 26 to establish communication with the externaldevice, and performs a communication operation.

When the communication operation is started, the system controller 10determines at step F1014 that the source switch trigger for designatingthe communication section 26 as the source has occurred.

As a result of it being determined at step F1014 that the source switchtrigger has occurred, control in the procedure of FIG. 13 performed bythe system controller 10 proceeds from step F105 to step F108, and thesystem controller 10 switches the image source to the communicationsection 26 to display the image data received by the communicationsection 26 on the display section 2.

The above process makes it possible, when an external device (e.g., theimaging apparatus 70 or the content source device 71 as illustrated inFIG. 2) has accessed the display apparatus 1 in the specified region orfacility, to display the image received from the external device on thedisplay section 2.

For example, it is conceivable that a guide image, an alarm image, aservice image of the region or facility is provided to the user.

It is also conceivable that, when the user is watching a sport, theimage as illustrated in (a) of FIG. 7 provided by a promoter, forexample, is provided to the user of the display apparatus 1.

It is also conceivable that, depending on the region, the bird's-eyeview image as illustrated in (c) of FIG. 7 is provided to the user.

(a) of FIG. 23 illustrates an exemplary procedure for determining theoccurrence of the source switch trigger based on the analysis performedby the imaging object sensor 20 or the image analysis section 17. Thisexemplary procedure can be adopted when the display apparatus 1 has theimaging function system as illustrated in FIG. 3.

At step F1101 in (a) of FIG. 23, the system controller 10 determineswhether or not the photographed image is being displayed on the displaysection 2 with the imaging function system as the source. When thephotographed image is being displayed, the process of (a) of FIG. 23 isnot performed. Meanwhile, when the image reproduced in the storagesection 25 or the image received by the communication section 26 isbeing displayed on the display section 2, for example, the systemcontroller 10 proceeds to step F1102.

At step F1102, the system controller 10 monitors the informationobtained from the image analysis section 17 or the information obtainedfrom the imaging object sensor 20. It is assumed here that the imageanalysis section 17 is analyzing the data of the image photographed bythe imaging section 3, and detects whether the photographed imageincludes a specified object as a subject of the imaging section 3.Examples of the specified object include a person, an animal, astructure, and a natural object. Alternatively, it may be so arrangedthat the imaging object sensor 20 is the pyroelectric sensor, and thatit is determined whether or not the imaging object is a living body suchas a person or an animal as the specified object.

If the system controller 10 determines, based on the informationobtained from the image analysis section 17 or the information obtainedfrom the imaging object sensor 20, that the photographed image includesthe specified object, the system controller 10 proceeds from step F1103to step F1104, and determines that a source switch trigger fordesignating the imaging function system (i.e., the imaging section 3 andthe imaging signal processing section 15) as the source has occurred.

As a result of it being determined at step F1104 that the source switchtrigger has occurred, control in the procedure of FIG. 13 performed bythe system controller 10 proceeds from step F105 to step F108, and thesystem controller 10 switches the image source to the imaging functionsystem to display the image photographed by the imaging section 3 on thedisplay section 2.

The above process makes it possible, when the specified object appearsin front of the user while the user is viewing the reproduced image orthe received image, for example, to switch the display on the displaysection 2 to the photographed image.

(b) of FIG. 23 illustrates an exemplary procedure for determining theoccurrence of the source switch trigger based on the time and thecurrent position.

At step F1110 in (b) of FIG. 23, the system controller 10 acquires thecurrent time from the date/time calculation section 22. At step F1111,the system controller 10 acquires the information on the currentposition based on the latitude and longitude of the current positionobtained by the GPS receiver section 21.

At step F1112, the system controller 10 determines whether or not thecurrent time is a specified time and the user is currently at aspecified place. If it is determined at step F1112 that the user is atthe specified place at the specified time, the system controller 10proceeds to step F1113, and determines that the source switch triggerhas occurred.

As a result of it being determined at step F1113 that the source switchtrigger has occurred, control in the procedure of FIG. 13 performed bythe system controller 10 proceeds from step F105 to step F108, and thesystem controller 10 switches the image source.

For example, when the user is at the specified place at the specifiedtime, the image source may be switched to the storage section 25, sothat the image reproduced in the storage section 25 is displayed.

Alternatively, when the user is at the specified place at the specifiedtime, the image source may be switched to the imaging function system,so that the photographed image is displayed.

Alternatively, when the user is at the specified place at the specifiedtime, the image source may be switched to the communication section 26,so that the image received by the communication section 26 is displayed.This operation can be applied to a service provided by a content servicesystem that provides a content at the specified place at the specifiedtime.

As the procedures of FIGS. 22 and 23, examples of the processes ofdetermining whether or not the source switch trigger has occurred basedon the outside world information have been described above, but theseexamples are only illustrative and not restrictive. A great variety ofother examples are conceivable as examples of the determination ofwhether or not the source switch trigger has occurred.

The determination of whether the source switch trigger has occurredmakes it possible to switch the image source in accordance with thesituation, so that an image appropriate for the user can be provided tothe user.

Returning to FIG. 13, the occurrence of the display start triggerdetermined at step F102 and the occurrence of the display terminationtrigger determined at step F106 may also be determined by the systemcontroller 10 based on the outside world information.

For example, it may be so arranged that the brightness of thesurroundings is detected as in the procedure of FIG. 14, and that whenit is determined that it is dark in the surroundings, the systemcontroller 10 determines that the display start trigger has occurred,and accordingly switches from the through state to a displaying state inwhich the image is displayed.

It may be so arranged that the weather is detected as in the procedureof FIG. 15, and that the system controller 10 determines whether thedisplay start trigger has occurred in accordance with the detectedweather.

It may be so arranged that the temperature and humidity are detected asin the procedure of FIG. 16, and that the system controller 10determines that the display start trigger has occurred when apredetermined condition is satisfied.

It may be so arranged that the occurrence of the display start triggeris determined based on the time period, the month and day, the season,or the like as in the procedure of FIG. 17.

It may be so arranged that the occurrence of the display start triggeris determined when the current position has become a predetermined placeas in the procedure of FIG. 18. This makes it possible to activate adisplay function at a specified place or based on the type of thefacility.

In the case where the information obtained by the image analysis section17 is detected as in the procedures of FIGS. 19 to 21, and when theimage analysis section 17 analyzes the photographed image data, theoccurrence of the display start trigger may be determined when thespecified object is detected, when the quick motion is detected, whenthe specified person is detected, or when brightness variations aredetected, for example.

In the case where the occurrence of a trigger for starting monitordisplay is determined in such manners as described above and control inthe procedure of FIG. 13 is caused to proceed to step F103 when it isdetermined that the trigger has occurred, the user, who is wearing thedisplay apparatus 1 whose display section 2 is in the through state,will see the display operation started in accordance with the situationwithout the need for the user to perform any particular operation, andthe user will be able to view an image suited to the situation.

The occurrence of the display termination trigger may also be determinedin similar manners.

In the case where the brightness of the surroundings is detected as inthe procedure of FIG. 14, for example, the occurrence of the displaytermination trigger may be determined based on the brightness of thesurroundings.

It may be so arranged that the weather is detected as in the procedureof FIG. 15, and that the system controller 10 determines whether thedisplay termination trigger has occurred in accordance with the detectedweather.

It may be so arranged that the temperature and humidity are detected asin the procedure of FIG. 16, and that the system controller 10determines that the display termination trigger has occurred when apredetermined condition is satisfied.

It may be so arranged that the occurrence of the display terminationtrigger is determined based on the time period, the month and day, theseason, or the like as in the procedure of FIG. 17.

It may be so arranged that the occurrence of the display terminationtrigger is determined when the current position has become apredetermined place as in the procedure of FIG. 18. This makes itpossible to deactivate the display function at a specified place orbased on the type of the facility.

In the case where the information obtained by the image analysis section17 is detected as in the procedures of FIGS. 19 to 21, and when theimage analysis section 17 analyzes the photographed image data, theoccurrence of the display termination trigger may be determined based ona result of the analysis.

In the case where the occurrence of a trigger for terminating themonitor display is determined in such manners as described above andcontrol in the procedure of FIG. 13 is caused to return to step F101when it is determined that the trigger has occurred, the display section2 of the display apparatus 1 is able to automatically enter the throughstate when the need felt by the user for the monitor display has beenreduced or eliminated, or when the user desires to prohibit a monitordisplay function, for example.

[6. Effects of Embodiments, Exemplary Variants, and ExemplaryExpansions]

Embodiments of the present invention have been described above. In theabove-described embodiments, the image is displayed in front of the eyesof the user via the display section 2 attached to the spectacle-shapedor head-mounted wearing unit, and based on the outside worldinformation, such as the brightness of the surroundings as the outsideworld situation, the weather, a condition of the subject, recognition ofthe specified object in the image data, the motion of the object, theplace, or the date and time, the control of the display operation or theselection of the display source is performed, so that an accuratedisplay operation suited to the situation or an entertaining displayoperation is performed without the need for the user to perform anyoperation. Thus, the display apparatus 1 is a convenient apparatus forthe user, and is capable of providing a variety of scenes within his orher field of vision.

Moreover, the transmissivity of the display section 2 can be controlledto cause the display section 2 to enter the transparent or translucentthrough state. This serves to prevent an interference from occurring inthe user's daily life even while the user is wearing the displayapparatus 1 via the wearing unit. Thus, advantages of the displayapparatus 1 according to the above-described embodiments can be enjoyedeffectively in the user's daily life.

In the above-described embodiments, control concerning the displayoperation, among others, has been described. Note, however, thatswitching between power-on, power-off, and standby states, control ofthe volume or sound quality of the audio outputted via the audio outputsection 5, or the like may be performed based on the outside worldinformation. For example, it is conceivable that the volume control isperformed in accordance with the time or place, or that the volume ofsurrounding sound is detected and the volume of a speaker output iscontrolled in accordance with the detected volume of the surroundingsound.

Note that the appearance and structure of the display apparatus 1 arenot limited to those illustrated in FIGS. 1, 3, and 4, but that variousvariants are possible.

The example that the spectacle-shaped or head-mounted wearing unit beingincluded as the display image 1 is described above; however, the displayapparatus of the present invention has only to be configured to displaythe image in front of the eye(s) of the user, and it may be the wearingunit used for the user to wear the display apparatus of any type, suchas a headphone type, a neckband type, a behind-the-ear type, or thelike. Further, the display apparatus may be attached to commonspectacles, visor, headphone, or the like via a fixing device such as aclip so that the display apparatus will be worn by the user.

1. (canceled)
 2. A display apparatus, comprising: a wearing memberhaving at least one eye piece, the wearing member configured to befitted around a head of a user, the at least one eye piece including adisplay; an external imaging apparatus configured to image an outsidescene image around the display apparatus; and circuitry configured tocontrol the display to display an image, wherein the image includes theoutside scene image imaged by the external imaging apparatus and a videocontent image, and the circuitry is further configured to adjust theimage such that the outside scene image and the video content image arebalanced in terms of brightness.
 3. The display apparatus according toclaim 2, wherein the circuitry is further configured to increase abrightness level of the video content image such that the outside sceneimage and the video content image are balanced in terms of brightness.4. The display apparatus according to claim 2, wherein the circuitry isfurther configured to decrease a brightness level of the video contentimage such that the outside scene image and the video content image arebalanced in terms of brightness.
 5. The display apparatus according toclaim 2, further comprising a surrounding environment sensor configuredto detect information of surroundings around the display apparatus. 6.The display apparatus according to claim 5, wherein the surroundingenvironment sensor includes an illumination sensor configured to detectinformation on brightness of the surroundings.
 7. The display apparatusaccording to claim 6, wherein the circuitry is configured to adjust theimage based on the information on brightness of the surroundingsdetected by the illumination sensor.
 8. The display apparatus accordingto claim 2, further comprising a memory, and the video content is animage stored in the memory and reproduced by the circuitry.
 9. Thedisplay apparatus according to claim 2, wherein the video content is animage received and reproduced by the circuitry.
 10. A method forcontrolling a display apparatus, the display apparatus including awearing member and an external imaging apparatus configured to image anoutside scene image around the display apparatus, the wearing memberhaving at least one eye piece, the wearing member configured to befitted around a head of a user, the at least one eye piece including adisplay, the method comprising: controlling, by circuitry, the displayto display an image, wherein the image includes the outside scene imageimaged by the external imaging apparatus and a video content image, andthe method further comprising adjusting the image such that the outsidescene image and the video content image are balanced in terms ofbrightness.
 11. A non-transitory computer readable medium having acomputer program recorded thereon, the computer program configured toperform a method when executed on a display apparatus, the displayapparatus including a wearing member and an external imaging apparatusconfigured to image an outside scene image around the display apparatus,the wearing member having at least one eye piece, the wearing memberconfigured to be fitted around a head of a user, the at least one eyepiece including a display, the method comprising: controlling thedisplay to display an image, wherein the image includes the outsidescene image imaged by the external imaging apparatus and a video contentimage, and the method further comprising adjusting the image such thatthe outside scene image and the video content image are balanced interms of brightness.